Source description
About the role
We are looking for a skilled Data Engineer with strong hands-on experience in Azure and Databricks to build scalable data pipelines and optimize data workflows. The ideal candidate will be responsible for designing ETL/ELT processes, transforming and enriching data, handling structured and unstructured datasets, and supporting business analytics through efficient data modeling and performance tuning. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using Azure DatabricksExtract, transform, and load data from multiple data sources (structured & unstructured)Clean, validate, and enrich data at various processing stagesDevelop and optimize data models (dimensional modeling, star schema, etc.)Monitor, troubleshoot, and improve performance of data pipelines and SQL queriesEnsure data quality, consistency, and governance standardsCollaborate with BI, analytics, and business stakeholders to understand requirementsImplement best practices for performance tuning and cost optimization in Azure Required Skills & Qualifications Strong hands-on experience with Azure DatabricksGood understanding of Azure Data Lake, Azure Data Factory, and related Azure servicesStrong SQL skills (complex joins, aggregations, query optimization)Experience with PySpark / Apache SparkExperience building and maintaining ETL/ELT workflowsKnowledge of data modeling conceptsExperience handling unstructured textual dataStrong analytical and problem-solving skills Good to Have Experience with Delta LakeCI/CD experience for data pipelinesKnowledge of data governance and security best practicesExposure to cloud data warehousing solutions Skills: azure,data bricks,data warehouse We are looking for a skilled Data Engineer with strong hands-on experience in Azure and Databricks to build scalable data pipelines and optimize data workflows. The ideal candidate will be responsible for designing ETL/ELT processes, transforming and enriching data, handling structured and unstructured datasets, and supporting business analytics through efficient data modeling and performance tuning. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using Azure DatabricksExtract, transform, and load data from multiple data sources (structured & unstructured)Clean, validate, and enrich data at various processing stagesDevelop and optimize data models (dimensional modeling, star schema, etc.)Monitor, troubleshoot, and improve performance of data pipelines and SQL queriesEnsure data quality, consistency, and governance standardsCollaborate with BI, analytics, and business stakeholders to understand requirementsImplement best practices for performance tuning and cost optimization in Azure Required Skills & Qualifications Strong hands-on experience with Azure DatabricksGood understanding of Azure Data Lake, Azure Data Factory, and related Azure servicesStrong SQL skills (complex joins, aggregations, query optimization)Experience with PySpark / Apache SparkExperience building and maintaining ETL/ELT workflowsKnowledge of data modeling conceptsExperience handling unstructured textual dataStrong analytical and problem-solving skills Good to Have Experience with Delta LakeCI/CD experience for data pipelinesKnowledge of data governance and security best practicesExposure to cloud data warehousing solutions Skills: azure,data bricks,data warehouse
More at Zorba AI