Senior Databricks Support Engineer (Noida)

Profile : Senior Azure Databricks Support Engineer Location : Noida Experience : 7+ Years Contact : We are seeking a Senior Azure Databricks Support Engineer with solid expertise in production support, Azure cloud, Databricks, PySpark, Python, SQL, and ETL/ELT pipelines. The ideal candidate will be responsible for managing mission-critical production environments, resolving complex incidents, supporting deployments, optimizing platform performance, and collaborating with development teams to ensure seamless transition from support to production. This role combines production operations (60%) with development and automation (40%) to improve platform reliability, scalability, and operational efficiency. Key Responsibilities Production Support - Provide L3 production support for Azure Databricks workloads, data pipelines, notebooks, workflows, and clusters. - Monitor production environments and proactively identify performance bottlenecks. - Troubleshoot failures in ETL/ELT pipelines and Spark jobs with minimal business impact. - Handle critical production incidents, perform Root Cause Analysis (RCA), and implement permanent fixes. - Ensure compliance with SLA, KPI, and ITIL support processes. - Participate in 24x7 on-call and rotational production support. Databricks Administration - Manage Azure Databricks workspaces, clusters, jobs, libraries, and Unity Catalog. - Configure autoscaling, cluster policies, security, and access controls. - Optimize Spark jobs for performance, cost, and resource utilization. - Monitor cluster health and recommend infrastructure improvements. Development & Production Readiness - Develop and enhance PySpark, Python, and SQL code for data processing. - Support migration of code from Development QA UAT Production. - Review deployment packages and validate production readiness. - Assist developers in resolving production defects and performance issues. - Perform code optimization and support release ma .