Source description
About the role
Job Title: Data Engineer (Azure Databricks) Experience: 5+ Years Location: Hyderabad (Work From Office) Roles & Responsibilities Design and develop scalable data pipelines using Azure Databricks, Azure Data Factory (ADF), and Python. Build and optimize ETL/ELT workflows for processing large volumes of data. Develop data transformation jobs using PySpark in Azure Databricks. Write and optimize complex SQL queries for data extraction, transformation, and reporting. Integrate data from multiple sources into Azure Data Lake and Databricks. Develop and maintain Power BI dashboards and datasets. Monitor, troubleshoot, and optimize Databricks jobs and ADF pipelines for performance. Ensure data quality, security, and governance across data platforms. Collaborate with Data Analysts, BI Developers, and business teams to deliver data-driven solutions. Follow best practices for code quality, documentation, and deployment. Required Skills 5+ years of experience in Data Engineering. Strong hands-on experience with Azure Databricks and PySpark. Experience with Azure Data Factory (ADF). Strong programming skills in Python. Advanced knowledge of SQL. Experience with Power BI reporting and dashboard development. Experience working with Azure Data Lake (ADLS) and cloud-based data solutions. Good understanding of ETL/ELT, data warehousing, and performance optimization. Strong analytical and problem-solving skills. Job Title: Data Engineer (Azure Databricks) Experience: 5+ Years Location: Hyderabad (Work From Office) Roles & Responsibilities Design and develop scalable data pipelines using Azure Databricks, Azure Data Factory (ADF), and Python. Build and optimize ETL/ELT workflows for processing large volumes of data. Develop data transformation jobs using PySpark in Azure Databricks. Write and optimize complex SQL queries for data extraction, transformation, and reporting. Integrate data from multiple sources into Azure Data Lake and Databricks. Develop and maintain Power BI dashboards and datasets. Monitor, troubleshoot, and optimize Databricks jobs and ADF pipelines for performance. Ensure data quality, security, and governance across data platforms. Collaborate with Data Analysts, BI Developers, and business teams to deliver data-driven solutions. Follow best practices for code quality, documentation, and deployment. Required Skills 5+ years of experience in Data Engineering. Strong hands-on experience with Azure Databricks and PySpark. Experience with Azure Data Factory (ADF). Strong programming skills in Python. Advanced knowledge of SQL. Experience with Power BI reporting and dashboard development. Experience working with Azure Data Lake (ADLS) and cloud-based data solutions. Good understanding of ETL/ELT, data warehousing, and performance optimization. Strong analytical and problem-solving skills.
More at BeetleRim