Data Engineer (Azure)

As an experienced Azure Data Engineer, your role involves designing, developing, and optimizing scalable data solutions on the Microsoft Azure platform. You should have strong expertise in Azure Data Engineering, Python, PySpark, SQL, and Databricks, with hands-on experience in building modern data pipelines and data lake architectures. Key Responsibilities: - Design, develop, and maintain scalable ETL/ELT data pipelines using Azure services. - Build and optimize data processing solutions using PySpark and Azure Databricks. - Develop robust data ingestion frameworks from multiple structured and unstructured data sources. - Create and maintain data models, data warehouses, and data lakes to support business analytics. - Write complex SQL queries, stored procedures, and performance optimization scripts. - Collaborate with business stakeholders, data analysts, and application teams to understand data requirements. - Implement data quality, governance, security, and monitoring processes. - Troubleshoot and resolve data-related issues, ensuring high availability and reliability. - Participate in code reviews, design discussions, and best practice implementation. - Support cloud migration and modernization initiatives involving Azure data platforms. Qualifications Required: - Strong experience in Azure Data Engineering. - Proficiency in Python and PySpark. - Hands-on experience with Azure Databricks. - Advanced knowledge of SQL and database concepts. - Experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Synapse Analytics. - Understanding of data warehousing and big data technologies. - Experience in performance tuning and optimization of data pipelines. - Knowledge of CI/CD practices and version control tools such as Git. - Bachelor's or Master's degree in Engineering, Computer Science, Information Technology, or a related field. Equivalent educational qualifications with relevant experience will also be considered. In addition to the above details, the job description does not provide any additional information about the company. As an experienced Azure Data Engineer, your role involves designing, developing, and optimizing scalable data solutions on the Microsoft Azure platform. You should have strong expertise in Azure Data Engineering, Python, PySpark, SQL, and Databricks, with hands-on experience in building modern data pipelines and data lake architectures. Key Responsibilities: - Design, develop, and maintain scalable ETL/ELT data pipelines using Azure services. - Build and optimize data processing solutions using PySpark and Azure Databricks. - Develop robust data ingestion frameworks from multiple structured and unstructured data sources. - Create and maintain data models, data warehouses, and data lakes to support business analytics. - Write complex SQL queries, stored procedures, and performance optimization scripts. - Collaborate with business stakeholders, data analysts, and application teams to understand data requirements. - Implement data quality, governance, security, and monitoring processes. - Troubleshoot and resolve data-related issues, ensuring high availability and reliability. - Participate in code reviews, design discussions, and best practice implementation. - Support cloud migration and modernization initiatives involving Azure data platforms. Qualifications Required: - Strong experience in Azure Data Engineering. - Proficiency in Python and PySpark. - Hands-on experience with Azure Databricks. - Advanced knowledge of SQL and database concepts. - Experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Synapse Analytics. - Understanding of data warehousing and big data technologies. - Experience in performance tuning and optimization of data pipelines. - Knowledge of CI/CD practices and version control tools such as Git. - Bachelor's or Master's degree in Engineering, Computer Science, Information Technology, or a related field. Equivalent educational qualifications with relevant experience will also be considered. In addition to the above details, the job description does not provide any additional information about the company.