Big Data Engineer

As a GCP/Big Data Engineer, you will be responsible for leading Big Data platform migrations from on-prem Hadoop/legacy data platforms to GCP. Your role will involve designing target-state architectures using tools such as BigQuery, Dataproc, Dataflow, and GCS. You will also need to define migration strategies which may include re-hosting, re-platforming, or re-engineering existing solutions. Key Responsibilities: - Architect and develop large-scale PySpark applications - Refactor existing Spark, Hive, or MapReduce jobs for GCP - Optimize data pipelines for performance, scalability, and cost efficiency - Implement batch and streaming workloads on GCP Qualifications Required: - BE/B Tech, BCA/MCA with a minimum of 5 years of experience as a GCP/Big Data Engineer - Proficiency in designing target-state architectures using BigQuery, Dataproc, Dataflow, GCS - Hands-on experience in Big Data platform migrations from on-prem Hadoop/legacy data platforms to GCP - Willingness to work in Bangalore - Availability to join within 15 days (Note: No additional details about the company were provided in the job description) As a GCP/Big Data Engineer, you will be responsible for leading Big Data platform migrations from on-prem Hadoop/legacy data platforms to GCP. Your role will involve designing target-state architectures using tools such as BigQuery, Dataproc, Dataflow, and GCS. You will also need to define migration strategies which may include re-hosting, re-platforming, or re-engineering existing solutions. Key Responsibilities: - Architect and develop large-scale PySpark applications - Refactor existing Spark, Hive, or MapReduce jobs for GCP - Optimize data pipelines for performance, scalability, and cost efficiency - Implement batch and streaming workloads on GCP Qualifications Required: - BE/B Tech, BCA/MCA with a minimum of 5 years of experience as a GCP/Big Data Engineer - Proficiency in designing target-state architectures using BigQuery, Dataproc, Dataflow, GCS - Hands-on experience in Big Data platform migrations from on-prem Hadoop/legacy data platforms to GCP - Willingness to work in Bangalore - Availability to join within 15 days (Note: No additional details about the company were provided in the job description)