Software Engineer, Data Engineering

Role Overview: You will be a critical member of the data engineering team, responsible for building robust and scalable data pipelines to support internal and client-facing analytics. Your role will involve designing, developing, and maintaining data pipelines to ensure high-quality and timely data for critical decision-making. Key Responsibilities: - Design and implement highly scalable and reliable data pipelines using tools like Apache Spark, Hadoop, or similar. - Develop and maintain ETL processes for large datasets. - Work with cloud-based data warehousing solutions such as Snowflake, BigQuery. - Ensure data quality and integrity through robust testing and monitoring. - Collaborate with data scientists and analysts to understand and fulfill their data requirements. - Optimize data pipelines for performance and cost-efficiency. - Document processes and contribute to knowledge sharing within the team. Qualifications Required: - Bachelor's degree in Computer Science or a related field. - 3 years of experience in data engineering. - Experience with big data technologies like Spark, Hadoop, etc. - Experience with cloud-based data warehousing solutions such as Snowflake, BigQuery, etc. - Proficiency in SQL and at least one scripting language like Python or Scala. - Strong understanding of data warehousing principles. (Note: Additional details about the company were not included in the provided job description) Role Overview: You will be a critical member of the data engineering team, responsible for building robust and scalable data pipelines to support internal and client-facing analytics. Your role will involve designing, developing, and maintaining data pipelines to ensure high-quality and timely data for critical decision-making. Key Responsibilities: - Design and implement highly scalable and reliable data pipelines using tools like Apache Spark, Hadoop, or similar. - Develop and maintain ETL processes for large datasets. - Work with cloud-based data warehousing solutions such as Snowflake, BigQuery. - Ensure data quality and integrity through robust testing and monitoring. - Collaborate with data scientists and analysts to understand and fulfill their data requirements. - Optimize data pipelines for performance and cost-efficiency. - Document processes and contribute to knowledge sharing within the team. Qualifications Required: - Bachelor's degree in Computer Science or a related field. - 3 years of experience in data engineering. - Experience with big data technologies like Spark, Hadoop, etc. - Experience with cloud-based data warehousing solutions such as Snowflake, BigQuery, etc. - Proficiency in SQL and at least one scripting language like Python or Scala. - Strong understanding of data warehousing principles. (Note: Additional details about the company were not included in the provided job description)