Senior Data Engineer - Medallion Architecture

We are looking for a highly skilled Senior Data Engineer to design, build, and operate scalable cloud-native data platforms for global customers. You will work on modern data architectures, large-scale ETL/ELT systems, streaming pipelines, and AI-driven data platforms using Databricks, PySpark, Azure, and Kafka. This role requires strong hands-on engineering expertise along with architecture thinking, production ownership, and customer-facing communication skills. Role : Senior Data Engineer Location : Bangalore or Pune (Hybrid) Education : BE/BTech OR ME/MTech Experience : 4+ Years Key Responsibilities : - Modernize legacy and non-scalable data architectures into cloud-native platforms - Design and implement Medallion Architecture (Bronze, Silver, Gold) using Delta Lake and Databricks - Build scalable ETL/ELT pipelines using PySpark, SQL, and Databricks notebooks - Develop and manage workflows using Databricks Workflows / Jobs - Optimize Spark jobs for performance, scalability, and cost efficiency - Implement data quality, governance, and lineage using DLT Expectations and Unity Catalog - Build real-time and event-driven data pipelines using Kafka or similar streaming technologies - Ensure platform reliability through monitoring, observability, and alerting - Collaborate with global customers and cross-functional engineering teams - Participate in architecture reviews, technical design, and best practice implementation Required Skills : - 4+ years of experience in Data Engineering / Big Data Engineering - Strong hands-on experience with Databricks ecosystem - Deep expertise in PySpark and distributed data processing - Experience with Delta Lake, DLT, Unity Catalog, and Databricks Workflows - Strong understanding of ETL/ELT pipelines and data modeling - Experience with Azure Data Platform (ADLS, Azure services) - Experience with Kafka or event-streaming platforms - Good understanding of scalable distributed systems and event-driven architecture - Strong problem-solving and analytical skills - Excellent communication and stakeholder management skills - Experience working with global customers in client-facing environments Good to Have : - Healthcare / HealthTech domain experience - EHR/EMR migration projects - FHIR, HL7, CDA standards - HIPAA compliance exposure - Experience with Patient 360 or Master Patient Index platforms - AI-assisted development tool exposure Why Join Us - Opportunity to work on cutting-edge AI and SaaS platforms - Exposure to global customers across North America, EU, UAE, and Australia - High ownership and fast growth environment - Flexible work culture focused on outcomes - Work alongside accomplished global engineering teams - Opportunity to influence architecture, product, and business outcomes We are looking for a highly skilled Senior Data Engineer to design, build, and operate scalable cloud-native data platforms for global customers. You will work on modern data architectures, large-scale ETL/ELT systems, streaming pipelines, and AI-driven data platforms using Databricks, PySpark, Azure, and Kafka. This role requires strong hands-on engineering expertise along with architecture thinking, production ownership, and customer-facing communication skills. Role : Senior Data Engineer Location : Bangalore or Pune (Hybrid) Education : BE/BTech OR ME/MTech Experience : 4+ Years Key Responsibilities : - Modernize legacy and non-scalable data architectures into cloud-native platforms - Design and implement Medallion Architecture (Bronze, Silver, Gold) using Delta Lake and Databricks - Build scalable ETL/ELT pipelines using PySpark, SQL, and Databricks notebooks - Develop and manage workflows using Databricks Workflows / Jobs - Optimize Spark jobs for performance, scalability, and cost efficiency - Implement data quality, governance, and lineage using DLT Expectations and Unity Catalog - Build real-time and event-driven data pipelines using Kafka or similar streaming technologies - Ensure platform reliability through monitoring, observability, and alerting - Collaborate with global customers and cross-functional engineering teams - Participate in architecture reviews, technical design, and best practice implementation Required Skills : - 4+ years of experience in Data Engineering / Big Data Engineering - Strong hands-on experience with Databricks ecosystem - Deep expertise in PySpark and distributed data processing - Experience with Delta Lake, DLT, Unity Catalog, and Databricks Workflows - Strong understanding of ETL/ELT pipelines and data modeling - Experience with Azure Data Platform (ADLS, Azure services) - Experience with Kafka or event-streaming platforms - Good understanding of scalable distributed systems and event-driven architecture - Strong problem-solving and analytical skills - Excellent communication and stakeholder management skills - Experience working with global customers in client-facing environments