Padmi

Big Data + GCP Engineer

Delhi NCRPosted 3 months ago
Software engineeringSeniorFull Time
Apply at whitefield careers

Opens the source posting on foundit.in

Source description

About the role

View original

Job Description Position: Big Data + GCP Engineer (GKE & FastAPI) Location : Gurgaon Experience Required: 6+ Years Work Model: Fulltime - Hybrid-3 days/week from the client office in Gurgaon Job Summary We are looking for an energetic, high-performing, and highly skilled Big Data + GCP Engineer with strong expertise in Google Cloud Platform (GCP), Big Data technologies, GKE, and FastAPI. The ideal candidate should have hands-on experience in designing, developing, and deploying scalable cloud-native applications using Java, PySpark, and modern data engineering technologies. The candidate must possess strong experience in Big Data processing, cloud infrastructure, containerized deployments, API development, and database optimization. Exposure to Kubernetes-based deployments and modern microservices architecture is highly preferred. Key Responsibilities Design, develop, and deploy scalable applications on Google Cloud Platform (GCP). Develop robust and high-performance data processing pipelines using PySpark and Big Data technologies. Build and maintain RESTful APIs and microservices using FastAPI. Work with large-scale distributed data processing frameworks such as Spark, Hive, MapReduce, and HBase. Deploy and manage containerized applications using Google Kubernetes Engine (GKE). Develop cloud-native solutions using GCP services such as Compute Engine, App Engine, Cloud Functions, BigQuery, Cloud SQL, Dataproc, and Dataflow. Optimize database queries, indexing strategies, and overall application performance. Collaborate with cross-functional teams including data engineering, DevOps, and application development teams. Perform troubleshooting, debugging, and root cause analysis for production issues. Create reusable components, automation scripts, and deployment pipelines. Ensure best practices in scalability, security, reliability, and maintainability. Mandatory Skills 6+ years of overall IT experience. Strong hands-on experience with Google Cloud Platform (GCP). Strong programming expertise in Java 8+ and PySpark. Hands-on experience in Big Data technologies: Apache Spark Hive MapReduce HBase Strong experience with FastAPI development. Hands-on experience with Google Kubernetes Engine (GKE). Strong understanding of distributed data processing and cloud architecture. Experience with GCP services: Compute Engine App Engine Cloud Functions BigQuery Cloud SQL Dataproc Dataflow Experience in UNIX, Shell scripting, Python, or Perl scripting. Strong knowledge of relational databases such as PostgreSQL, MySQL, or DB2. Experience in query optimization and database indexing. Good understanding of CI/CD and containerization concepts. Strong analytical, problem-solving, and debugging skills. Educational Qualification Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

One address, no account. We’ll tell you when matching roles go live.

More at whitefield careers

Related open roles

View all roles