Pyspark Spark + Hadoop - Chennai/ Bangalore Location

Job Description

Skill Set

• Python,Hadoop,Spark

• Total Experience :

• 4.00 to 13.00 Years

• No of Openings :

• 1

• Job Post Date :

• 21/07/2026

• Job Expiry Date :

• 31/10/2026

• Domain :

• IT

• Location :

• CHENNAI [India]

• Job Reference No :

• 4097105

• Recommend to friend

• Job Summary

• Job Title: Data Engineer

• Location: TechM Chennai ELCOT

• Years of Experience: 5 7 Years

• Job Summary:

We are seeking a skilled Data Engineer with a strong foundation in Python to join our dynamic team at TechM in Chennai. The ideal candidate will have 5 7 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization.

Responsibilities

• Design, develop, and maintain robust data pipelines to support data ingestion, transformation, and storage.

• Collaborate with data scientists and analysts to understand data requirements and deliver high quality datasets.

• Implement data models and architectures that support business intelligence and analytics initiatives.

• Optimize data processing workflows for performance and scalability.

• Ensure data quality and integrity through rigorous testing and validation processes.

• Monitor and troubleshoot data pipeline performance, addressing issues as they arise.

• Document data engineering processes, architectures, and best practices for team knowledge sharing.

• Stay updated with industry trends and emerging technologies in data engineering.

• Mandatory Skills:

• Strong proficiency in Python, with experience in data manipulation libraries such as Pandas and NumPy.

• Experience with data warehousing solutions and ETL processes.

• Familiarity with SQL and relational databases.

• Knowledge of big data technologies such as Hadoop, Spark, or similar frameworks.

• Experience with cloud platforms (AWS, Azure, or Google Cloud) for data storage and processing.

• Understanding of data modeling concepts and best practices.

• Preferred Skills:

• Experience with data visualization tools (e.g., Tableau, Power BI).

• Familiarity with machine learning concepts and frameworks.

• Knowledge of containerization technologies (e.g., Docker, Kubernetes).

• Experience with version control systems (e.g., Git).

• Strong problem solving skills and the ability to work independently and collaboratively.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.

• 5 7 years of experience in data engineering or a related role.

• Proven experience in building and maintaining data pipelines and architectures.

• Strong analytical skills and attention to detail.

• Excellent communication skills, both verbal and written.

• If you are passionate about data engineering and possess the required skills, we invite you to apply and join our innovative team at TechM in Chennai.

• Recommend to Friend

• Please enter your Name

• Please enter your email

• Please enter your Friends Name

• Please enter your friend's emailId Please enter valid email id , e.g. abc@gmail.com