Source description
About the role
Job Title: Data Engineer (Azure Databricks) Experience: 5+ Years Location: Hyderabad (Work From Office) Roles & Responsibilities - Design and develop scalable data pipelines using Azure Databricks, Azure Data Factory (ADF), and Python. - Build and optimize ETL/ELT workflows for processing large volumes of data. - Develop data transformation jobs using PySpark in Azure Databricks. - Write and optimize complex SQL queries for data extraction, transformation, and reporting. - Integrate data from multiple sources into Azure Data Lake and Databricks. - Develop and maintain Power BI dashboards and datasets. - Monitor, troubleshoot, and optimize Databricks jobs and ADF pipelines for performance. - Ensure data quality, security, and governance across data platforms. - Collaborate with Data Analysts, BI Developers, and business teams to deliver data-driven solutions. - Follow best practices for code quality, documentation, and deployment. Required Skills - 5+ years of experience in Data Engineering. - Solid hands-on experience with Azure Databricks and PySpark. - Experience with Azure Data Factory (ADF). - Strong programming skills in Python. - Advanced knowledge of SQL. - Experience with Power BI reporting and dashboard development. - Experience working with Azure Data Lake (ADLS) and cloud-based data solutions. - Good understanding of ETL/ELT, data warehousing, and performance optimization. - Strong analytical and problem-solving skills. .
More at BeetleRim