Padmi

Data Engineer

ChennaiPosted 1 month ago
Software engineeringMid-levelFull Time
Apply at IntraEdge

Opens the source posting on foundit.in

Source description

About the role

View original

Job Title: Data Engineer (Big Data & GCP) Location: Chennai [Hybrid to client location] Experience: 4–8 Years Employment Type: Full-Time Job Summary We are looking for a skilled Data Engineer with strong expertise in Big Data technologies and Google Cloud Platform (GCP). The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and data architectures to support advanced analytics and business intelligence needs. Key Responsibilities Design, develop, and maintain scalable data pipelines using Apache Spark and Scala . Work with large datasets using Hive SQL and optimize query performance. Develop and manage data solutions on Google Cloud Platform (GCP) including Google Cloud Storage and BigQuery . Build robust ETL pipelines to ingest, transform, and load data from multiple sources. Implement and maintain efficient data models to support analytics and reporting. Ensure data quality, integrity, and governance across data platforms. Collaborate with cross-functional teams including Data Analysts, Data Scientists, and Business stakeholders. Troubleshoot and optimize data workflows for performance and scalability. Required Skills & Qualifications Strong experience in Big Data technologies (Hadoop ecosystem preferred). Hands-on experience with Scala and Apache Spark . Proficiency in Hive SQL and advanced query optimization. Experience working with GCP services such as BigQuery and Google Cloud Storage . Solid understanding of ETL processes and data pipeline development. Strong knowledge of Data Modeling (dimensional and relational models). Good understanding of distributed data processing and performance tuning. Preferred Qualifications Experience with workflow orchestration tools like Airflow . Knowledge of Python for data processing. Familiarity with data warehousing concepts and modern data architectures. Experience in handling real-time or streaming data pipelines is a plus.

One address, no account. We’ll tell you when matching roles go live.

More at IntraEdge

Related open roles

View all roles