Source description
About the role
Job Title: Senior Data Engineer (Spark | SQL | Airflow) Experience: 5+ Years Location: Bangalore Work Mode: Work from Office (WFO) About the Role We are looking for a highly skilled Senior Data Engineer with strong expertise in SQL, Apache Spark, and Apache Airflow to build and optimize scalable data pipelines. The ideal candidate should have hands-on experience working with large datasets, designing efficient ETL/ELT workflows, and ensuring reliable data delivery for analytics and business intelligence. Key Responsibilities Design, build, and optimize large-scale ETL/ELT pipelines using Apache Spark . Develop, optimize, and maintain complex SQL queries for processing large volumes of data. Build, schedule, and monitor data pipelines using Apache Airflow . Collaborate with Data Science, Analytics, and Engineering teams to ensure high-quality and reliable data. Implement best practices for data engineering, performance optimization, and pipeline reliability. Work with structured and semi-structured data to support business reporting and analytics. Required Skills & Qualifications 5+ years of experience in Data Engineering . Strong expertise in SQL (Primary evaluation area). Complex SQL queries Query optimization Joins, CTEs, Window Functions Performance tuning Hands-on experience with Apache Spark . Distributed data processing Spark DataFrame APIs Performance optimization Experience with Apache Airflow for workflow orchestration and scheduling. Strong understanding of Data Modeling and Data Warehousing concepts. Excellent problem-solving and analytical skills. Good to Have Experience with cloud platforms ( AWS, GCP, or Azure ). Proficiency in Python . Experience with Delta Lake and Parquet . Interview Focus The technical evaluation will primarily focus on SQL proficiency , including: Complex query writing Query optimization Window functions Joins and CTEs Performance tuning Candidates should also demonstrate practical knowledge of Apache Spark and Apache Airflow through hands-on problem-solving and technical discussions.
More at Moolya