Padmi

Data Engineer( Data bricks)

IndiaPosted 1 month ago
Software engineeringMid-levelFull Time; Regular
Apply at CareerVitaBLR

Opens the source posting on shine.com

Source description

About the role

View original

Job Description: We are seeking a skilled Data Engineer to design, build, and maintain scalable data solutions on the Azure platform. The ideal candidate will play a key role in developing robust data pipelines, ensuring data quality, and contributing to enterprise-wide analytics initiatives. Key Responsibilities: Design and develop scalable data pipelines using Spark SQL and PySpark on Azure Databricks Build and orchestrate ETL workflows using Azure Data Factory (ADF) Develop and maintain a modern Lakehouse architecture leveraging ADLS and Databricks Perform data preparation tasks including data cleaning, normalization, deduplication, and data type transformations Collaborate with DevOps teams to deploy and manage solutions in production environments Monitor data pipelines, identify issues, and implement corrective actions, including root cause analysis and resolution Actively contribute as part of the global Analytics team, delivering data-driven insights and solutions Collaborate with Data Science and Business Intelligence teams to share best practices and drive innovation Lead data engineering projects and support cross-functional initiatives led by other team members Apply change management practices, including documentation, communication, and training, to support system upgrades and data migrations Must-Have Skills Strong experience with Azure ecosystem (Azure Databricks, Azure Data Factory, ADLS) Proficiency in PySpark and Spark SQL Solid understanding of ETL processes and data pipeline development Advanced SQL skills .

One address, no account. We’ll tell you when matching roles go live.

More at CareerVitaBLR

Related open roles

View all roles
Data Engineer( Data bricks) at CareerVitaBLR · Padmi