Padmi

DataOps Engineer - (4 to 6 yrs exp) (Bengaluru)

BangalorePosted 1 month ago
Software engineeringMid-levelFull Time; Regular
Apply at Important Company of the Sector

Opens the source posting on shine.com

Source description

About the role

View original
  • Experience Range - 4 to 6 yrs - Responsible for the governance ensuring data availability, accuracy, and performance across environments as an expert Azure Data Ops with 4-6 years of experience. - Orchestrate, monitor, and automate data pipelines across Azure Data Factory, Databricks, and Synapse. - Build scalable CI/CD workflows using Azure DevOps for data deployments and version control. - Ensure data pipeline reliability through alerting, auto-restart, and SLA compliance. - Set up proactive alerts and error handling for failed or delayed pipelines. - Drive process standardization and documentation for repeatable and auditable data workflows. - Enable lineage and impact analysis across datasets to improve governance and trust. - Enforce data quality checks (DQ rules, schema validation, completeness) at ingestion and transformation stages. - Collaborate with governance teams to align with cataloging, retention, and compliance standards. - Continuously optimize data processing cost, performance, and resource utilization across environments. - Hands-on expertise in: Azure Data Factory, Databricks, Synapse, and Azure DevOps. CI/CD pipeline design for data workflows. Python, SQL, PowerShell scripting for automation. Data governance and observability tools. Preferred Familiarity with big data frameworks (Spark, Delta Lake). Experience in a retail data workplace. Azure certifications: Azure Data Engineer Associate or DevOps Engineer Expert. .

One address, no account. We’ll tell you when matching roles go live.

More at Important Company of the Sector

Related open roles

View all roles