Padmi

Lead Data Engineer Databricks |Delta Lake | Unity Catalog |Pyspark | Azure

BangalorePosted 1 month ago
Infrastructure And DatabasesSeniorFull Time; Regular
Apply at Sonata Software

Opens the source posting on shine.com

Source description

About the role

View original

NP_ Immediate joiner Only Work Location: Bengaluru Mode: WFO( All 5 Days). Data Hub Lead - JD Professional Work Experience 8+ years of experience in Data Engineering, Data Platforms, Analytics, or Cloud Data Architecture, with 35+ years of hands-on Databricks experience.Strong expertise in Databricks, Apache Spark, PySpark, Delta Lake, Unity Catalog, Databricks Workflows, and SQL.Proven experience designing and implementing modern Lakehouse architectures, large-scale data pipelines, and real-time data processing solutions.Deep knowledge of cloud platforms such as Azure (preferred), including data services, storage, networking, and security.Hands-on experience with ETL/ELT frameworks, data modeling, DataOps, CI/CD pipelines, and infrastructure automation.Experience building data products that support BI, Advanced Analytics, Machine Learning, and Generative AI use cases.Strong understanding of data governance, metadata management, data quality, lineage, privacy, and compliance frameworks.Proven track record leading technical teams, mentoring engineers, and delivering large-scale enterprise data transformation programs.Experience with DevOps/DataOps tools such as Azure DevOps, GitHub, Terraform, Jenkins, and Kubernetes is highly desirable.Databricks certifications such as Databricks Certified Data Engineer Professional, Databricks Certified Professional Data Architect, or equivalent are preferred. Strategic Purpose of the Position Due to expansion and increased complexity of Datahub solutions in the organization, Lead role requires to lead various regional business initiatives and ensuring data accuracy and security within datahub landscape. Position Description in Brief Lead team of 1-2 external developers, provide guidance in terms of project and tasks prioritization - 20% Work with various Global functions stakeholders to gather their data needs and consulting them on best-in-class solutions - 20% Manage delivery of the projects - 20% Create development tickets, manage backlog of open tickets and perform - 20% Understanding technology stack and help in designing of solutions in Cloud and On-prem - 20% .

One address, no account. We’ll tell you when matching roles go live.

More at Sonata Software

Related open roles

View all roles