Padmi

Technical Architect - Azure/Kafka/Spark

IndiaPosted 3 months ago
Software engineeringSeniorFull Time; Regular
Apply at Hirist.tech

Opens the source posting on shine.com

Source description

About the role

View original

As a Data Engineer in our company, your role will involve the following responsibilities: - Designing and building scalable data pipelines on Azure for batch and streaming workloads. - Developing high performance data transformations using Python, PySpark, and Spark. - Implementing and managing real-time data processing using Kafka. - Working with Azure data platforms such as Databricks, ADLS, and Synapse. - Writing and optimizing complex SQL queries for large datasets. - Applying data quality checks, validation, and monitoring for production pipelines. - Optimizing performance through Spark tuning, partitioning, and efficient data formats. - Collaborating with cross-functional teams in an Agile delivery environment. If shortlisted, you will be invited for initial rounds on 20th June 2026, Saturday in Bangalore. As a Data Engineer in our company, your role will involve the following responsibilities: - Designing and building scalable data pipelines on Azure for batch and streaming workloads. - Developing high performance data transformations using Python, PySpark, and Spark. - Implementing and managing real-time data processing using Kafka. - Working with Azure data platforms such as Databricks, ADLS, and Synapse. - Writing and optimizing complex SQL queries for large datasets. - Applying data quality checks, validation, and monitoring for production pipelines. - Optimizing performance through Spark tuning, partitioning, and efficient data formats. - Collaborating with cross-functional teams in an Agile delivery environment. If shortlisted, you will be invited for initial rounds on 20th June 2026, Saturday in Bangalore.

One address, no account. We’ll tell you when matching roles go live.

More at Hirist.tech

Related open roles

View all roles