Padmi

Senior Data Engineer - SQL

Delhi NCRPosted 2 months ago
Software engineeringSeniorFull Time; Regular
Apply at R Systems

Opens the source posting on shine.com

Source description

About the role

View original

As a Data Engineer, you will play a crucial role in designing, optimizing, and enhancing enterprise-grade Data Analytics solutions on Microsoft Azure. Your deep expertise in Azure data services, including Azure Databricks, Azure Data Factory (ADF), and Azure Data Lake Storage Gen2 (ADLS Gen2), along with strong CI/CD implementation experience, will be essential for success in this role. You will need to provide hands-on technical leadership, take ownership of the architecture, and mentor engineering teams while driving best practices in data engineering and DevOps. Key Responsibilities: - Lead the architecture, design, and optimization of scalable data platforms on Azure - Build and maintain robust data pipelines using Azure Data Factory (ADF) - Develop and optimize data transformations using Azure Databricks (PySpark/Scala/SQL) - Implement data lake architecture using Azure Data Lake Storage Gen2 (ADLS Gen2) - Design medallion architecture (Bronze/Silver/Gold layers) and data governance best practices - Ensure performance tuning, cost optimization, and security compliance of Azure resources - Implement CI/CD pipelines for data engineering workflows using Azure DevOps or similar tools Qualifications Required: - Proficiency in Azure data services such as Azure Databricks, Azure Data Factory, and Azure Data Lake Storage Gen2 - Experience in designing and optimizing scalable data platforms on Azure - Strong knowledge of CI/CD implementation and best practices in data engineering and DevOps (Note: There are no additional details about the company mentioned in the job description.) As a Data Engineer, you will play a crucial role in designing, optimizing, and enhancing enterprise-grade Data Analytics solutions on Microsoft Azure. Your deep expertise in Azure data services, including Azure Databricks, Azure Data Factory (ADF), and Azure Data Lake Storage Gen2 (ADLS Gen2), along with strong CI/CD implementation experience, will be essential for success in this role. You will need to provide hands-on technical leadership, take ownership of the architecture, and mentor engineering teams while driving best practices in data engineering and DevOps. Key Responsibilities: - Lead the architecture, design, and optimization of scalable data platforms on Azure - Build and maintain robust data pipelines using Azure Data Factory (ADF) - Develop and optimize data transformations using Azure Databricks (PySpark/Scala/SQL) - Implement data lake architecture using Azure Data Lake Storage Gen2 (ADLS Gen2) - Design medallion architecture (Bronze/Silver/Gold layers) and data governance best practices - Ensure performance tuning, cost optimization, and security compliance of Azure resources - Implement CI/CD pipelines for data engineering workflows using Azure DevOps or similar tools Qualifications Required: - Proficiency in Azure data services such as Azure Databricks, Azure Data Factory, and Azure Data Lake Storage Gen2 - Experience in designing and optimizing scalable data platforms on Azure - Strong knowledge of CI/CD implementation and best practices in data engineering and DevOps (Note: There are no additional details about the company mentioned in the job description.)

One address, no account. We’ll tell you when matching roles go live.

More at R Systems

Related open roles

View all roles