Source description
About the role
Role: Data Engineering Lead Experience: 8 to10 Years Preferred Location: Pune Interview Process Round 1: Virtual Technical Interview Round 2: Face-to-Face Interview (Pune) Mandate Round 3: Client Interview (Virtual) Role Overview We are looking for an experienced Data Engineering Lead with strong technical expertise and leadership skills to design, build, and optimize scalable data platforms. The ideal candidate should have hands-on experience with Python, big data technologies, cloud platforms, and enterprise data engineering practices while leading teams to deliver high-quality data solutions. Key Responsibilities Design, develop, and maintain scalable data pipelines, ETL/ELT workflows, and cloud-based data platforms. Build and optimize enterprise data solutions using Hadoop ecosystems, distributed computing frameworks, and relational databases. Develop efficient data models to support analytics, reporting, and machine learning initiatives. Collaborate with cross-functional teams to deliver data-driven business solutions. Implement data governance, security, privacy, and quality standards across data platforms. Lead technical design discussions and mentor data engineering teams. Build reliable, scalable, and high-performance data processing solutions. Optimize existing data pipelines for performance, scalability, and cost efficiency. Support AI/ML initiatives through robust data engineering and feature engineering pipelines. Drive DevOps and CI/CD best practices for data engineering projects. Required Skills & Experience 8-10 years of experience in Data Engineering. Strong programming expertise in: Python (Pandas, NumPy, PySpark) SQL Hands-on experience with: Hadoop Ecosystem Databricks Snowflake Azure and/or AWS Cloud Impala Strong experience in ETL/ELT development using: Apache Airflow Apache NiFi Azure Data Factory Experience with: Data Lakes Distributed Computing Data Warehousing CI/CD Pipelines DevOps Practices Knowledge of machine learning data pipelines and feature engineering. Excellent problem-solving, analytical, and communication skills. Preferred Skills Experience supporting Generative AI (GenAI) and LLM-based applications through scalable data pipelines. Familiarity with: Unstructured and Semi-Structured Data Processing Vector Databases AI Data Pipelines Data Governance for AI workloads Experience with monitoring, optimization, and cost-efficient cloud data platforms. Preferred Qualifications Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field. Experience leading enterprise-scale data engineering projects. Exposure to AI/ML platforms and modern cloud-native architectures is an added advantage. Our Commitment to Diversity & Inclusion Apexon has been certified as a Great Place To Work across the USA, India, the UK, and Mexico. We are committed to fostering an inclusive workplace where diversity is valued, and equal employment opportunities are provided to all qualified individuals. Our Commitment to Environment We actively support sustainable practices and encourage every employee to contribute to Apexon's environmental and ESG initiatives. Benefits & Perks Group Health Insurance for a family of four Term Life Insurance Personal Accident Insurance Paid Holidays & Earned Leaves Paid Parental Leave Learning & Career Development Programs Employee Wellness Programs Continuous Upskilling & Career Growth Opportunities
More at Apexon
Related open roles
Senior Golang Backend Developer Go, Python & Aws Karnataka
India
Senior Golang Backend Developer (Go, Python & AWS) (Karnataka)
India
Hiring: Java Full Stack Developer | WebFlux & Angular | 7+ Years
Bangalore · Hyderabad · Mumbai
Google Gemini Enterprise for Customer Experience (GECX) Expert Engineer
Bangalore
Java Full Stack Developer + Spring Webflux _5 years experience (Tamil Nadu)
India
Java Lead and Architect-Ahmedabad-Saturday(Ready To come face To face)
India