Tech Lead - Python Pyspark

Job Description

Skill Set

• SQL,Python,Hadoop,Hive,pyspark

• Total Experience :

• 5.00 to 9.00 Years

• No of Openings :

• 1

• Job Post Date :

• 20/07/2026

• Job Expiry Date :

• 31/08/2026

• Domain :

• IT

• Location :

• CHENNAI [India]

• Job Reference No :

• 4096977

• Recommend to friend

• Job Summary

• Job Title: Data Engineer

• Location: TechM Chennai ELCOT

• Years of Experience: 5 7 Years

• Job Summary:

We are seeking a skilled Data Engineer with a strong background in Python to join our dynamic team at TechM in Chennai. The ideal candidate will have 5 7 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization.

Responsibilities

• Design, develop, and maintain robust data pipelines and ETL processes to support data ingestion and transformation.

• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions.

• Implement data models and architectures that support business intelligence and analytics initiatives.

• Optimize data storage and retrieval processes to ensure efficient data access and performance.

• Monitor and troubleshoot data pipeline performance, ensuring data quality and reliability.

• Document data engineering processes, workflows, and best practices for future reference.

• Stay updated with industry trends and emerging technologies in data engineering and analytics.

• Mandatory Skills:

• Strong proficiency in Python, with experience in data manipulation and analysis libraries such as Pandas and NumPy.

• Experience with data warehousing solutions and ETL tools.

• Solid understanding of SQL and experience with relational databases.

• Familiarity with big data technologies such as Hadoop, Spark, or similar frameworks.

• Knowledge of cloud platforms (e.g., AWS, Azure, GCP) and their data services.

• Preferred Skills:

• Experience with data visualization tools (e.g., Tableau, Power BI).

• Understanding of machine learning concepts and frameworks.

• Experience with containerization technologies (e.g., Docker, Kubernetes).

• Familiarity with version control systems (e.g., Git).

• Strong problem solving skills and the ability to work independently and collaboratively.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.

• 5 7 years of experience in data engineering or a related role.

• Proven experience in building and maintaining data pipelines and architectures.

• Excellent communication skills, with the ability to convey complex technical concepts to non technical stakeholders.

• If you are passionate about data engineering and possess the required skills, we invite you to apply and join our innovative team at TechM in Chennai.

• Recommend to Friend

• Please enter your Name

• Please enter your email

• Please enter your Friends Name

• Please enter your friend's emailId Please enter valid email id , e.g. abc@gmail.com