Source description
About the role
Job Summary: We are seeking an experienced and motivated Data Engineering Lead to join our growing team. The ideal candidate will have a minimum of 3 years of hands-on experience in data engineering, with a strong focus on Spark. As a Data Engineering Lead, you will play a pivotal role in designing, developing, and maintaining our data infrastructure, as well as leading a team of data engineers to deliver high-quality solutions. Roles & Responsibilities: - Lead a team of data engineers in designing, building, and maintaining robust and scalable data pipelines and ELT/ ETL processes using Spark. - Collaborate closely with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and deliver effective solutions. - Architect and optimize data storage and processing solutions for performance, reliability, and scalability. - Design and implement data quality and data validation processes to ensure the accuracy and integrity of our data. - Stay up-to-date with the latest industry trends and best practices in data engineering and big data technologies. - Mentor and guide team members, providing technical leadership, code reviews, and knowledge sharing. - Participate in the full development lifecycle, from requirements gathering to deployment and monitoring. - Troubleshoot and resolve data pipeline issues, performance bottlenecks, and other technical challenges. - Develop and maintain documentation for data pipelines, processes, and procedures. Eligibility Criteria: - 80% and above in classes 10 and 12 - Bachelor's or Master's degree in Computer Science, Engineering, or a related field. - Senior Engineer - Data Engineering: Minimum of 2 years of professional experience in data engineering - Lead Engineer - Data Engineering: Minimum of 5 years of skilled experience in data engineering Skill Required: - Strong expertise in Apache Spark for processing and analyzing large datasets. - Experience of working with E .
More at IndiaMART