Source description
About the role
Hiring: Data Engineer ( Azure ) Experience: 5+ Years Location: Pune, Bhopal, Jaipur, Gurgaon, Delhi, Banglore, Work Mode:- Hybrid Notice Period: Immediate Joiners (Only immediate joiners & candidates serving notice period) Hiring: Databricks Data Engineer Lakeflow | Streaming | DBSQL | Data Intelligence We are looking for a Databricks Data Engineer to build reliable, scalable, and governed data pipelines powering analytics, operational reporting, and the Data Intelligence Layer. Key Responsibilities Build optimized batch pipelines using Delta Lake (partitioning, OPTIMIZE, Z-ORDER, VACUUM)Implement incremental ingestion using Databricks Autoloader with schema evolution & checkpointingDevelop Structured Streaming pipelines with watermarking, late data handling & restart safetyImplement declarative pipelines using LakeflowDesign idempotent, replayable pipelines with safe backfillsOptimize Spark workloads (AQE, skew handling, shuffle & join tuning)Build curated datasets for Databricks SQL (DBSQL), dashboards & downstream applicationsPackage and deploy using Databricks Repos & Asset Bundles (CI/CD)Ensure governance using Unity Catalog and embedded data quality checks Mandatory Skills (Must Have) Databricks & Delta Lake (Advanced Optimization & Performance Tuning)Structured Streaming & Autoloader ImplementationDatabricks SQL (DBSQL) & Data Modeling for Analytics Hiring: Data Engineer ( Azure ) Experience: 5+ Years Location: Pune, Bhopal, Jaipur, Gurgaon, Delhi, Banglore, Work Mode:- Hybrid Notice Period: Immediate Joiners (Only immediate joiners & candidates serving notice period) Hiring: Databricks Data Engineer Lakeflow | Streaming | DBSQL | Data Intelligence We are looking for a Databricks Data Engineer to build reliable, scalable, and governed data pipelines powering analytics, operational reporting, and the Data Intelligence Layer. Key Responsibilities Build optimized batch pipelines using Delta Lake (partitioning, OPTIMIZE, Z-ORDER, VACUUM)Implement incremental ingestion using Databricks Autoloader with schema evolution & checkpointingDevelop Structured Streaming pipelines with watermarking, late data handling & restart safetyImplement declarative pipelines using LakeflowDesign idempotent, replayable pipelines with safe backfillsOptimize Spark workloads (AQE, skew handling, shuffle & join tuning)Build curated datasets for Databricks SQL (DBSQL), dashboards & downstream applicationsPackage and deploy using Databricks Repos & Asset Bundles (CI/CD)Ensure governance using Unity Catalog and embedded data quality checks Mandatory Skills (Must Have) Databricks & Delta Lake (Advanced Optimization & Performance Tuning)Structured Streaming & Autoloader ImplementationDatabricks SQL (DBSQL) & Data Modeling for Analytics
More at Deqode