Source description
About the role
Job Description: Senior Databricks Engineer We are seeking a Senior Databricks Engineer to design and implement scalable, high-performance data engineering solutions on the Databricks Lakehouse Platform. In this role, you will be responsible for building and maintaining robust data pipelines, Delta Lake architectures, and feature stores that power analytics, reporting, and machine learning at enterprise scale. The ideal candidate combines deep expertise in Apache Spark with handson Databricks platform mastery, and approaches every pipeline with a mindset that balances throughput performance with data quality guarantees and governance requirements. Core Requirements Experience: 6+ years in Data Engineering with at least 3 years of handson Databricks platform experience in a production environment. Databricks Expertise: Deep knowledge of Databricks Runtime, cluster management, Delta Lake, DLT, Unity Catalog, and Databricks Workflows. Spark Proficiency: Expertlevel PySpark and Spark SQL development, including understanding of the Spark execution model, lazy evaluation, and DAG optimization. Cloud Platforms: Handson experience deploying Databricks on AWS, Azure (ADLS Gen2), or GCP with associated IAM and networking configurations. Python Development: Strong Python skills for pipeline logic, data transformations, utility libraries, and automation scripts. Data Governance: Experience implementing data governance controls on the Lakehouse including column masking, rowlevel security, and audit logging. Skill / Area Core Platform Databricks, Delta Lake, Delta Live Tables, Unity Catalog Languages PySpark, Spark SQL, Python, SQL Cloud Infrastructure Azure (ADLS Gen2), AWS (S3), GCP (GCS) Orchestration Databricks Workflows, Apache Airflow, Azure Data Factory More info : komal.kumari@nlbtech.com/9310244292 .
More at NLB Services