Source description
About the role
As a Data Engineer with over 5 years of experience, your role will involve designing and developing scalable data pipelines and engineering solutions. You will be responsible for writing clean, maintainable, and efficient code using Scala and Spark. Additionally, you will work with Azure or on-premises Hadoop ecosystem for data processing, solving real-world engineering problems related to data infrastructure, and collaborating with cross-functional teams to deliver data-driven solutions. Your key responsibilities will include ensuring data quality, reliability, and performance across data systems. Key Responsibilities: - Design and develop scalable data pipelines and engineering solutions - Write clean, maintainable, and efficient code using Scala and Spark - Work with Azure or on-premises Hadoop ecosystem for data processing - Solve real-world engineering problems related to data infrastructure - Collaborate with cross-functional teams to deliver data-driven solutions - Ensure data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), Python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python - SQL - AWS / Azure / GCP Preferred (Bonus) Skills: - Kubernetes exposure - Experience with multiple cloud platforms (AWS, Azure, GCP) As a Data Engineer with over 5 years of experience, your role will involve designing and developing scalable data pipelines and engineering solutions. You will be responsible for writing clean, maintainable, and efficient code using Scala and Spark. Additionally, you will work with Azure or on-premises Hadoop ecosystem for data processing, solving real-world engineering problems related to data infrastructure, and collaborating with cross-functional teams to deliver data-driven solutions. Your key responsibilities will include ensuring data quality, reliability, and performance across data systems. Key Responsibilities: - Design and develop scalable data pipelines and engineering solutions - Write clean, maintainable, and efficient code using Scala and Spark - Work with Azure or on-premises Hadoop ecosystem for data processing - Solve real-world engineering problems related to data infrastructure - Collaborate with cross-functional teams to deliver data-driven solutions - Ensure data quality, reliability, and performance across data systems Required Skills: - Scala (must-have), Python - Apache Spark - Strong coding fundamentals and engineering principles - Azure or on-premises Hadoop ecosystem experience - 5+ years of experience in Data Engineering - Python - SQL - AWS / Azure / GCP Preferred (Bonus) Skills: - Kubernetes exposure - Experience with multiple cloud platforms (AWS, Azure, GCP)
More at Altysys