Padmi

LEAD DATA ENGINEER - Azure Data Factory

BangalorePosted 1 month ago
Infrastructure And DatabasesSenior
Apply at Happiest Minds Technologies

Opens the source posting on jobs.happiestminds.com

Source description

About the role

View original

Job Description: Data Engineer ? Azure, Snowflake, Synapse, ETL/ELT Position Summary We are seeking an experienced Data Engineer with a minimum of 9-12 years in designing and implementing modern data solutions. The ideal candidate will have strong expertise in Azure Data Factory, mini data lake architectures, Snowflake, Azure Synapse Analytics, and ETL/ELT processes. This role involves building scalable data pipelines, optimizing workflows, and enabling advanced analytics for enterprise-grade solutions. Key Responsibilities ? Design, develop, and maintain robust ETL/ELT pipelines using Azure Data Factory (ADF) and SSIS. ? Implement and manage mini data lake solutions on Azure for efficient ingestion and storage. ? Build and optimize data models in Snowflake and Azure Synapse Analytics. ? Integrate data from multiple sources ensuring quality, consistency, and governance. ? Monitor and tune pipelines for scalability and cost efficiency. ? Implement automated workflows and deployment pipelines using Azure DevOps. ? Partner with BI teams, data scientists, and business stakeholders to deliver actionable insights. ? Maintain clear documentation of data flows, schemas, and governance policies. Required Skills and Qualifications ? Minimum 6+ years in data engineering with strong exposure to cloud-based data platforms. ? Advanced pipeline design and orchestration using Azure Data Factory (ADF). ? Proficient in Snowflake & Synapse for data modeling and query optimization. ? Hands-on experience with SSIS and modern ETL/ELT frameworks. ? Experience in mini data lake design and management on Azure. ? Strong SQL skills and familiarity with Python or PowerShell for automation. ? Knowledge of deployment automation and version control (Git). ? Excellent analytical, problem-solving, and communication skills. Preferred Skills ? Experience with Azure Databricks or other big data processing frameworks. ? Familiarity with data governance tools and data cataloging. ? Exposure to real-time data streaming (Azure Service Bus, Kafka, Event Hub). ? Knowledge of performance tuning for large-scale data systems. Certifications ? Microsoft Certified: Azure Data Engineer Associate ? Snowflake SnowPro Core Certification ? Any relevant Azure or Data Engineering certifications Key Performance Indicators (KPIs) ? Timely delivery of data pipelines and integration projects. ? Data accuracy and quality in all ETL/ELT processes. ? Performance optimization of data workflows and queries. ? Successful implementation of automation and CI/CD pipelines. ? Stakeholder satisfaction and collaboration effectiveness. ? Compliance with data governance and security standards. Job Description: Data Engineer ? Azure, Snowflake, Synapse, ETL/ELT Position Summary We are seeking an experienced Data Engineer with a minimum of 9-12 years in designing and implementing modern data solutions. The ideal candidate will have strong expertise in Azure Data Factory, mini data lake architectures, Snowflake, Azure Synapse Analytics, and ETL/ELT processes. This role involves building scalable data pipelines, optimizing workflows, and enabling advanced analytics for enterprise-grade solutions. Key Responsibilities ? Design, develop, and maintain robust ETL/ELT pipelines using Azure Data Factory (ADF) and SSIS. ? Implement and manage mini data lake solutions on Azure for efficient ingestion and storage. ? Build and optimize data models in Snowflake and Azure Synapse Analytics. ? Integrate data from multiple sources ensuring quality, consistency, and governance. ? Monitor and tune pipelines for scalability and cost efficiency. ? Implement automated workflows and deployment pipelines using Azure DevOps. ? Partner with BI teams, data scientists, and business stakeholders to deliver actionable insights. ? Maintain clear documentation of data flows, schemas, and governance policies. Required Skills and Qualifications ? Minimum 6+ years in data engineering with strong exposure to cloud-based data platforms. ? Advanced pipeline design and orchestration using Azure Data Factory (ADF). ? Proficient in Snowflake & Synapse for data modeling and query optimization. ? Hands-on experience with SSIS and modern ETL/ELT frameworks. ? Experience in mini data lake design and management on Azure. ? Strong SQL skills and familiarity with Python or PowerShell for automation. ? Knowledge of deployment automation and version control (Git). ? Excellent analytical, problem-solving, and communication skills. Preferred Skills ? Experience with Azure Databricks or other big data processing frameworks. ? Familiarity with data governance tools and data cataloging. ? Exposure to real-time data streaming (Azure Service Bus, Kafka, Event Hub). ? Knowledge of performance tuning for large-scale data systems. Certifications ? Microsoft Certified: Azure Data Engineer Associate ? Snowflake SnowPro Core Certification ? Any relevant Azure or Data Engineering certifications Key Performance Indicators (KPIs) ? Timely delivery of data pipelines and integration projects. ? Data accuracy and quality in all ETL/ELT processes. ? Performance optimization of data workflows and queries. ? Successful implementation of automation and CI/CD pipelines. ? Stakeholder satisfaction and collaboration effectiveness. ? Compliance with data governance and security standards. TIPTLG01-6-1 Job Description: Data Engineer ? Azure, Snowflake, Synapse, ETL/ELT Position Summary We are seeking an experienced Data Engineer with a minimum of 9-12 years in designing and implementing modern data solutions. The ideal candidate will have strong expertise in Azure Data Factory, mini data lake arch... Job Description: Data Engineer ? Azure, Snowflake, Synapse, ETL/ELT Position Summary We are seeking an experienced Data Engineer with a minim ... Job Description: Data Engineer ? Azure, Snowflake, Synapse, ETL/ELT Position Summary We are seeking an experienced Data Engineer with a minimum of 9-1... Azure, Snowflake, Synapse, ETL/ELT

One address, no account. We’ll tell you when matching roles go live.

More at Happiest Minds Technologies

Related open roles

View all roles