Padmi

Data Engineer - AWS Glue, Pyspark / Chennai / Bengaluru (Tamil Nadu)

ChennaiPosted 2 months ago
Infrastructure And DatabasesMid-levelFull Time; Regular
Apply at Mount Talent Consulting

Opens the source posting on shine.com

Source description

About the role

View original

Job SummaryWe are looking for a skilled Data Engineer with 4+ years of experience to join our team in Bangalore / Chennai. The ideal candidate will have strong expertise in PySpark and AWS, with the ability to build scalable data pipelines and work with large datasets in a cloud environment. Key Responsibilities - Design, develop, and maintain scalable data pipelines using PySpark - Build and optimize ETL workflows for structured and unstructured data - Work with AWS services (such as S3, EMR, Glue, Redshift, Lambda) for data processing and storage - Ensure data quality, integrity, and reliability across systems - Collaborate with data analysts, data scientists, and cross-functional teams - Monitor and troubleshoot data pipeline performance issues - Implement best practices for data governance, security, and compliance Required Skills & Qualifications - 4+ years of experience in data engineering or related roles - Strong hands-on experience with PySpark - Valuable exposure to AWS cloud services - Solid understanding of ETL concepts and data pipeline architecture - Proficiency in Python and SQL - Experience working with large-scale distributed systems - Familiarity with data warehousing concepts Education - Bachelors degree in Engineering Job SummaryWe are looking for a skilled Data Engineer with 4+ years of experience to join our team in Bangalore / Chennai. The ideal candidate will have strong expertise in PySpark and AWS, with the ability to build scalable data pipelines and work with large datasets in a cloud environment. Key Responsibilities - Design, develop, and maintain scalable data pipelines using PySpark - Build and optimize ETL workflows for structured and unstructured data - Work with AWS services (such as S3, EMR, Glue, Redshift, Lambda) for data processing and storage - Ensure data quality, integrity, and reliability across systems - Collaborate with data analysts, data scientists, and cross-functional teams - Monitor and troubleshoot data pipeline performance issues - Implement best practices for data governance, security, and compliance Required Skills & Qualifications - 4+ years of experience in data engineering or related roles - Strong hands-on experience with PySpark - Valuable exposure to AWS cloud services - Solid understanding of ETL concepts and data pipeline architecture - Proficiency in Python and SQL - Experience working with large-scale distributed systems - Familiarity with data warehousing concepts Education - Bachelors degree in Engineering

One address, no account. We’ll tell you when matching roles go live.

More at Mount Talent Consulting

Related open roles

View all roles