Senior Data Engineer

We're Hiring: Senior & Lead Data Engineers Location: Whitefield, Bangalore Platform Specialization: Databricks Project Scope: Complex DWH & Migration initiatives across the full data engineering lifecycle Are you passionate about building scalable data pipelines, optimizing performance, and solving real-world data challenges We're looking for hands-on Data Engineers and Lead engineers (5–10 years experience) who thrive in fast-paced environments and bring deep expertise in SQL, Python, Spark, Databricks, and cloud-native data platforms. Role Overview Senior Data Engineers (5–8 years): Build and optimize robust data pipelines for ingestion, transformation, and analytics Work across structured and semi-structured data sources, ensuring performance and reliability Collaborate with cross-functional teams to deliver scalable solutions on Databricks Strong coding skills in SQL, Python, and Spark are a must Experience in data validations, reconciliation, and quality checks across ingestion and transformation stages Lead Data Engineers (8–10 years): Own solution architecture and consultative delivery for complex DWH and migration projects Be hands-on with Databricks, Spark, and orchestration frameworks Guide teams on best practices, performance tuning, and modular design Engage with stakeholders to define scope, KPIs, and delivery milestones Lead validation strategies and ensure data integrity across migration workflows Core Skills & Competencies Must-Have Technical Skills: Advanced SQL (window functions, CTEs, performance tuning) Python (data manipulation, modular design, error handling) Advanced Apache Spark Programming Databricks (Notebooks, Delta Lake, Job Orchestration, Unity Catalog, Delta Live Tables, DB Asset Bundles, Lakehouse Architecture, Workspace Management, Cluster Configuration, MLflow Integration, and Role-Based Access Control) CI/CD pipelines, version control (Git), and testing frameworks Experience with cloud platforms (Azure, AWS, or GCP) Software Engineering Fundamentals: Clean code practices and modular design Agile delivery and sprint planning Debugging, logging, and exception handling Code reviews and mentoring junior engineers Understanding of system design and scalability Bonus Skills: Exposure to data modeling (dimensional, star/snowflake schemas) Familiarity with data governance, lineage, and cataloging tools Prior experience in large-scale data migration projects and validation frameworks