Padmi

Technology Lead | Cloud Platform | Amazon Webservices DevOps

United States · OnsitePosted 2 months ago
Software engineeringUnspecified
Apply at IPolarity

Opens the source posting on jobsapi.ceipal.com

Source description

About the role

View original

Job Title: Kafka Expert with Agentic AI Skills Work Location: Saint LouisMO63131 Vendor Rate: 66.50 Contract duration: 12 Target Start Date: 08 Jul 2026 Does this position require Visa independent candidates only? YES face to face is mandatory for Interview Onsite work set-up Job Details: Detailed Job Description Must Have Skills:: Apache Kafka Expertise • Strong hands-on experience with Apache Kafka (Kafka Streams, Kafka Connect, Brokers) • Designing, implementing, and managing Kafka-based streaming architectures • Performance tuning, scalability, and reliability of Kafka clusters • Agentic AI / Generative AI • Hands-on experience with Agentic AI frameworks and LLM orchestration tools (e.g., LangChain, AutoGen, CrewAI, Semantic Kernel) • Experience building autonomous AI workflows, agents, and AI-driven decision systems • Architecture & Integration • Strong knowledge of event-driven architecture • Experience with microservices architecture and real-time data processing • Real-Time Data Engineering • Developing, optimizing, and maintaining real-time streaming/data pipelines • Troubleshooting and monitoring high-volume data streams Nice to Have Skills: Cloud platform experience (Azure, AWS, or GCP) Experience with real-time analytics platforms and monitoring tools • Grafana • Prometheus • ELK Stack • Datadog • Splunk Experience with containerization and orchestration • Docker • Kubernetes Exposure to MLOps or AI deployment pipelines Experience integrating Kafka with cloud-native data services Knowledge of vector databases and RAG architectures Experience working in large-scale enterprise environments Job Description Job Title: Kafka Expert with Agentic AI Skills Role Summary: Seeking a Kafka expert with experience in Agentic AI to design, build, and optimize real-time data pipelines and intelligent autonomous systems. Key Responsibilities: • Design and manage Kafka-based streaming architectures • Develop and optimize real-time data processing pipelines • Build and integrate Agentic AI solutions (LLMs, autonomous workflows) • Ensure scalability, reliability, and performance of data systems • Collaborate with AI, data, and engineering teams Required Skills: • Strong experience with Apache Kafka (Streams, Connect, brokers) • Proficiency in Python/Java and distributed systems • Hands-on experience with Agentic AI / LLM frameworks (e.g., LangChain, AutoGen) • Knowledge of event-driven architecture and microservices Good to Have: • Cloud platforms (Azure/AWS/GCP) • Experience with real-time analytics and monitoring tools Minimum years of experience 5-8 years Certifications Needed :No Top 3 responsibilities you would expect the Subcon to shoulder and execute Hardware refresh plan capacity model, sizing, architecture diagrams, consumer group strategies for performance and cost.Own upgrades, patches, and migrations.Implement and manage Kafka components Kafka Connect, Schema Registry, MirrorMakerConfluent Replicator, REST Proxy familiarity with Kafka Streams and ksqlDB is a plus.Performanc risk registerImplement and validated onprem clusters on refreshed hardware with performance benchmarksOperational documentation standards, runbooks, monitoringalerts Interview Process (Is face to face required?) Yes Any additional information you would like to share about the project specs/ nature of work Project Code: CHC WO for CFOBI

One address, no account. We’ll tell you when matching roles go live.

More at IPolarity

Related open roles

View all roles