Source description
About the role
Roles and Responsibilities : Design, develop, test, deploy and maintain large-scale data pipelines using Airflow on Microsoft Azure. Collaborate with cross-functional teams to gather requirements and design solutions for complex data processing needs. Develop high-quality code in Python using Synapse Analytics to build scalable and efficient data workflows. Troubleshoot issues related to pipeline failures, data quality problems, and performance optimization. Job Requirements : 3-10 years of experience as a Data Engineer with expertise in AWS or Microsoft Azure cloud platforms. Strong proficiency in programming languages such as Python and familiarity with SQL DW (Synapse Analytics). Experience working with various file formats including CSV, JSON, XML, flat files etc. Roles and Responsibilities : Design, develop, test, deploy and maintain large-scale data pipelines using Airflow on Microsoft Azure. Collaborate with cross-functional teams to gather requirements and design solutions for complex data processing needs. Develop high-quality code in Python using Synapse Analytics to build scalable and efficient data workflows. Troubleshoot issues related to pipeline failures, data quality problems, and performance optimization. Job Requirements : 3-10 years of experience as a Data Engineer with expertise in AWS or Microsoft Azure cloud platforms. Strong proficiency in programming languages such as Python and familiarity with SQL DW (Synapse Analytics). Experience working with various file formats including CSV, JSON, XML, flat files etc.
More at Digitechserve