Data Engineer (Java/Python & Kafka)

Primary Skills Data Engineer with Python, PySpark & Kafka OR Java Developer with Springboot, Spark & Kafka Years of experience 6-8 Years Availability to Join Immediate ONLY Job Description Job Summary: CGI is looking for a skilled and proactive Data Engineer with hands-on experience in Kafka streaming, Apache Spark. The ideal candidate will play a key role in designing, developing, and deploying scalable backend systems and real-time data pipelines. This position is ideal for someone passionate about building high-performance systems and working with cutting-edge technologies in cloud-native environments. Key Responsibilities: Develop real-time data streaming applications using Apache Kafka and Kafka Streams. Build and optimize large-scale batch and stream processing pipelines with Apache Spark. Containerize applications and manage deployments using Kubernetes. Collaborate with DevOps teams to ensure CI/CD pipelines are robust and scalable. Write unit tests and conduct code reviews to maintain code quality and reliability. Troubleshoot and debug production issues across multiple environments. Required qualifications to be successful in this role Strong programming skills in Python/Java. Hands-on experience with Apache Kafka, Kafka Streams, and event-driven architecture. Solid knowledge of Apache Spark (batch and streaming). Familiarity with microservices architecture, RESTful APIs, and distributed systems. Experience with build tools such as Maven or Gradle. Familiar with Git, Jenkins, CI/CD pipelines, and Agile development practices. Excellent problem-solving skills and ability to work in a fast-paced environment. Education: Bachelors or Masters degree in Computer Science, Engineering, or related field. Location Hyderabad (ONLY) Shifts & Mode of Work General Shifts, Initial 8 weeks WFO, Later Hybrid