Source description
About the role
As a Data Engineer, you will play a crucial role in designing, optimizing, and enhancing enterprise-grade Data Analytics solutions on Microsoft Azure. Your deep expertise in Azure data services, including Azure Databricks, Azure Data Factory (ADF), and Azure Data Lake Storage Gen2 (ADLS Gen2), along with strong CI/CD implementation experience, will be essential for success in this role. You will need to provide hands-on technical leadership, take ownership of the architecture, and mentor engineering teams while driving best practices in data engineering and DevOps. Key Responsibilities: - Lead the architecture, design, and optimization of scalable data platforms on Azure - Build and maintain robust data pipelines using Azure Data Factory (ADF) - Develop and optimize data transformations using Azure Databricks (PySpark/Scala/SQL) - Implement data lake architecture using Azure Data Lake Storage Gen2 (ADLS Gen2) - Design medallion architecture (Bronze/Silver/Gold layers) and data governance best practices - Ensure performance tuning, cost optimization, and security compliance of Azure resources - Implement CI/CD pipelines for data engineering workflows using Azure DevOps or similar tools Qualifications Required: - Proficiency in Azure data services such as Azure Databricks, Azure Data Factory, and Azure Data Lake Storage Gen2 - Experience in designing and optimizing scalable data platforms on Azure - Strong knowledge of CI/CD implementation and best practices in data engineering and DevOps (Note: There are no additional details about the company mentioned in the job description.) As a Data Engineer, you will play a crucial role in designing, optimizing, and enhancing enterprise-grade Data Analytics solutions on Microsoft Azure. Your deep expertise in Azure data services, including Azure Databricks, Azure Data Factory (ADF), and Azure Data Lake Storage Gen2 (ADLS Gen2), along with strong CI/CD implementation experience, will be essential for success in this role. You will need to provide hands-on technical leadership, take ownership of the architecture, and mentor engineering teams while driving best practices in data engineering and DevOps. Key Responsibilities: - Lead the architecture, design, and optimization of scalable data platforms on Azure - Build and maintain robust data pipelines using Azure Data Factory (ADF) - Develop and optimize data transformations using Azure Databricks (PySpark/Scala/SQL) - Implement data lake architecture using Azure Data Lake Storage Gen2 (ADLS Gen2) - Design medallion architecture (Bronze/Silver/Gold layers) and data governance best practices - Ensure performance tuning, cost optimization, and security compliance of Azure resources - Implement CI/CD pipelines for data engineering workflows using Azure DevOps or similar tools Qualifications Required: - Proficiency in Azure data services such as Azure Databricks, Azure Data Factory, and Azure Data Lake Storage Gen2 - Experience in designing and optimizing scalable data platforms on Azure - Strong knowledge of CI/CD implementation and best practices in data engineering and DevOps (Note: There are no additional details about the company mentioned in the job description.)
More at R Systems