Source description
About the role
Role Overview: You are seeking a Senior Data Platform Engineer with extensive hands-on experience to build and scale enterprise-grade data pipelines on Azure and Databricks. This role requires deep technical expertise, strong ownership, and the ability to independently deliver complex, production-ready data solutions while setting engineering best practices. Key Responsibilities: - Build scalable pipelines using Databricks (DLT, Autoloader, Workflows) and Azure services - Extend metadata-driven ingestion frameworks (declarative, reusable) - Develop modular PySpark code and libraries (WHL packaging) - Implement Delta Lake patterns (CDC, SCD Type 2, merges) - Optimize SQL workloads for performance and cost - Orchestrate pipelines via Synapse or UC4 - Apply data modeling (Kimball, 3NF, lakehouse) - Implement CI/CD with Azure DevOps - Enforce governance via Unity Catalog - Mentor engineers and contribute to engineering standards Qualifications Required: - Cloud Platform: Azure (ADLS Gen2, Key Vault, Azure SQL, Entra ID) Proficiency Level: Advanced (Deep hands-on, production-scale design & troubleshooting) Role Overview: You are seeking a Senior Data Platform Engineer with extensive hands-on experience to build and scale enterprise-grade data pipelines on Azure and Databricks. This role requires deep technical expertise, strong ownership, and the ability to independently deliver complex, production-ready data solutions while setting engineering best practices. Key Responsibilities: - Build scalable pipelines using Databricks (DLT, Autoloader, Workflows) and Azure services - Extend metadata-driven ingestion frameworks (declarative, reusable) - Develop modular PySpark code and libraries (WHL packaging) - Implement Delta Lake patterns (CDC, SCD Type 2, merges) - Optimize SQL workloads for performance and cost - Orchestrate pipelines via Synapse or UC4 - Apply data modeling (Kimball, 3NF, lakehouse) - Implement CI/CD with Azure DevOps - Enforce governance via Unity Catalog - Mentor engineers and contribute to engineering standards Qualifications Required: - Cloud Platform: Azure (ADLS Gen2, Key Vault, Azure SQL, Entra ID) Proficiency Level: Advanced (Deep hands-on, production-scale design & troubleshooting)
More at Birlasoft