Source description
About the role
GCP Data Engineer (Pyspark/Scala/Kafka/Bigquery) Experience: 5 - 12 Years Location – Hybrid - Bangalore iitjobs is looking for highly skilled Data Engineers with strong expertise in Scala, Kafka, Spark, and GCP . The ideal candidate should have hands-on experience building scalable data pipelines, processing large volumes of data, and working directly with clients to deliver high-quality data engineering solutions Required Skills:- 5–12 years of overall experience in Data Engineering. Strong hands-on experience with: Apache Kafka (streaming, producers/consumers, topic management) Apache Spark (batch & streaming) Scala (advanced programming expertise) Experience working on Google Cloud Platform (GCP) Solid understanding of data engineering concepts, distributed systems, and big data architectures. Experience working with large-scale data processing and pipeline development. Strong problem-solving and leadership skills. Key Responsibilities:- Lead the design and development of scalable, fault-tolerant data pipelines and streaming architectures. Build and maintain real-time and batch data processing systems using Kafka, Spark, Scala and GCP Architect large-scale data solutions ensuring performance, reliability, and security. Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions. Mentor and guide junior engineers; drive best practices in coding, design, and deployment. Optimize data workflows and improve system efficiency and scalability. Implement monitoring, logging, and alerting mechanisms for data platforms. Drive adoption of modern data engineering practices (CI/CD, data quality frameworks, etc.).
More at IIT JOBS INC
Related open roles
JAVA Technical Coach - @Bangalore
Bangalore
software development II Full Stack (Java/React) (Karnataka)
India
Microsoft Fabrics developer
Bangalore · Mumbai · Hybrid
Devops Engineer Pune City (India)
Mumbai
SAP ABAP+RF Programming Consultant (Pune)
Mumbai
Freelance Remote Opportunity AI Tech Lead (Generative AI & LLMs)
India