Consultant Java with Kafka (Chennai)

Job Post: Consultant Java with Kafka Company: Coherent Pixel Systems Role: Consultant Java with Kafka Experience: 5 9 Years Location: Remote Work Mode: Fully Remote Job Summary Coherent Pixel Systems is looking for an experienced Java Developer with Kafka to design, develop, and maintain high-performance data ingestion and transformation pipelines. The ideal candidate should have strong expertise in Java, Apache Kafka, Apache NiFi, and ETL processes, with the ability to work in a fast-paced, data-driven environment. Primary Skills - Java - Apache Kafka - Apache NiFi - ETL Pipeline Development Good to Have - Experience with Rules Processing Engine (RPE) - Data Transformation Tools - Experience with Bloblang-based parsing and transformation (Benthos/Redpanda) Key Responsibilities - Develop and maintain scalable data ingestion and ETL pipelines. - Design, configure, and optimize Bloblang-based parsing and transformation logic within Redpanda/Benthos pipelines. - Execute and manage Data Management (DM) and Rules Processing Engine (RPE) batch processes. - Monitor, troubleshoot, and resolve database and pipeline-related issues to ensure data accuracy and processing efficiency. - Collaborate with engineering and data teams to improve pipeline performance and implement current data requirements. - Ensure compliance with data quality, security, and operational best practices. - Support QA teams during testing by validating pipelines, analyzing defects, and verifying data accuracy. - Work closely with the product team to identify issues, support testing activities, and ensure timely delivery of pipeline-related features. - Provide support for environment-related issues, including server downtime, system interruptions, and restoration activities. Preferred Candidate Profile - 59 years of experience in Java-based application development. - Strong hands-on experience with Apache Kafka and Apache NiFi. - Experience in designing and supporting ETL/data processing pipelin .