Padmi

Big Data Engineer

Delhi NCRPosted 3 months ago
Infrastructure And DatabasesMid-levelFull Time; Regular
Apply at Pacific It Consulting

Opens the source posting on shine.com

Source description

About the role

View original

As a GCP + Big Data Engineer with 5+ years of experience, your role will involve designing, developing, and maintaining scalable data engineering solutions on Google Cloud Platform (GCP). Your key skills and responsibilities will include: Role Overview: You will be responsible for working on various GCP services such as BigQuery, Google Cloud Storage (GCS), Composer, Dataflow, and Dataproc to develop and optimize ETL/data processing pipelines. Your expertise in writing and optimizing SQL queries, strong programming skills in Python, and experience in Big Data processing will be crucial for this role. Key Responsibilities: - Design, develop, and maintain scalable data engineering solutions on GCP - Work on BigQuery, Dataflow, Composer, and Dataproc-based implementations - Develop and optimize ETL/data processing pipelines - Write efficient SQL queries and Python-based data transformation logic - Collaborate with cross-functional teams for solution development and support - Troubleshoot performance and production-related issues Qualifications Required: - 5+ years of experience as a GCP + Big Data Engineer - Strong hands-on experience with GCP services such as BigQuery, GCS, Composer, Dataflow, and Dataproc - Strong programming skills in Python - Expertise in writing and optimizing SQL queries - Experience in Big Data processing and cloud-based data engineering solutions Please note that this is a contract opportunity with a hybrid work mode (3 days work from office) based in Bangalore, Gurgaon, Noida, or Pune under the payroll of Pacific IT. As a GCP + Big Data Engineer with 5+ years of experience, your role will involve designing, developing, and maintaining scalable data engineering solutions on Google Cloud Platform (GCP). Your key skills and responsibilities will include: Role Overview: You will be responsible for working on various GCP services such as BigQuery, Google Cloud Storage (GCS), Composer, Dataflow, and Dataproc to develop and optimize ETL/data processing pipelines. Your expertise in writing and optimizing SQL queries, strong programming skills in Python, and experience in Big Data processing will be crucial for this role. Key Responsibilities: - Design, develop, and maintain scalable data engineering solutions on GCP - Work on BigQuery, Dataflow, Composer, and Dataproc-based implementations - Develop and optimize ETL/data processing pipelines - Write efficient SQL queries and Python-based data transformation logic - Collaborate with cross-functional teams for solution development and support - Troubleshoot performance and production-related issues Qualifications Required: - 5+ years of experience as a GCP + Big Data Engineer - Strong hands-on experience with GCP services such as BigQuery, GCS, Composer, Dataflow, and Dataproc - Strong programming skills in Python - Expertise in writing and optimizing SQL queries - Experience in Big Data processing and cloud-based data engineering solutions Please note that this is a contract opportunity with a hybrid work mode (3 days work from office) based in Bangalore, Gurgaon, Noida, or Pune under the payroll of Pacific IT.

One address, no account. We’ll tell you when matching roles go live.