AI/ML Engineer - Agentic AI & LLM Systems

Role: AI/ML Engineer - Agentic AI & LLM Systems Function: Artificial Intelligence / Machine Learning Engineering Type: Full-time Industry: Information Technology & Services, Management Consulting About CompanyThe company is a digital engineering firm founded in 2020 and headquartered in Tampa, Florida. It specializes in AI-driven digital transformation for enterprises. Over 450 professionals work across seven global offices, including Bangalore, Trivandrum, Toronto, Dallas, Belgrade, Johannesburg, and Bogota. The company has completed 55+ enterprise projects across 25+ countries. In 2023, it expanded its product engineering capabilities by acquiring a product engineering firm. It operates with a fast-paced, ownership-driven culture built on agility, client-centricity, and ethical execution. Position OverviewThis role sits at the intersection of applied AI research and production engineering. You will own the design and delivery of agentic AI systems and LLM-powered applications that solve real enterprise problems at scale. Responsibilities include architecting multi-agent pipelines, RAG systems, and LLM integrations - taking them from prototype to production. You will collaborate with data engineers, product managers, and domain experts across the company's global delivery network. The ideal candidate brings both depth in agent orchestration and the engineering rigor to ship reliable, observable AI systems. Role & ResponsibilitiesDesign and implement end-to-end RAG pipelines - including chunking strategies, vector store selection, retrieval optimization, and context injection - for production LLM applicationsBuild and orchestrate multi-agent systems using LangChain, LangGraph, AutoGen, CrewAI, or Azure ADK, including agent reasoning loops, tool use, and inter-agent collaboration patternsDevelop and maintain backend services in Java/Spring Boot to expose LLM capabilities as REST APIs and integrate with enterprise microservicesIntegrate LLMs from multiple providers (OpenAI, Anthropic, Meta/Llama) with robust prompt libraries, function-calling patterns, and fallback strategies for production reliabilityDesign semantic storage layers using vector databases (Pinecone, Weaviate, Milvus, Chroma, or FAISS) and knowledge graphs for retrieval and reasoningBuild evaluation frameworks and observability tooling to monitor agent performance, hallucination rates, latency, and cost across deployed systemsMaintain code quality and technical documentation, and contribute to internal knowledge sharing on emerging agentic AI patterns and LLM best practicesMust Have Criteria4+ years of software development experience, with at least 12 years of hands-on experience building and deploying LLM-based or AI/ML systems in productionHands-on experience with LangChain and LangGraph for LLM application development, including RAG architecture design and implementationProficiency with at least one agentic AI framework: AutoGen, CrewAI, or Azure ADK (Agent Development Kit)3+ years of professional Java development with Spring Boot and Spring Framework, including REST API design and microservices architecturePractical experience integrating LLMs from providers such as OpenAI (GPT-4), Anthropic (Claude), or Meta (Llama), including prompt engineering and function-calling patternsHands-on experience with vector databases - Pinecone, Weaviate, Milvus, Chroma, or FAISS - for semantic search and RAG pipelinesProficiency with Python for AI/ML scripting and development alongside Java-based backend workNice to HaveExperience with containerization (Docker) and orchestration (Kubernetes) for deploying AI workloadsFamiliarity with cloud platforms - AWS, Azure, or GCP - and serverless architectures for LLM servingKnowledge of LLM fine-tuning, transfer learning, or model optimization techniquesExperience with CI/CD pipelines, monitoring, logging, or observability tools in an MLOps or LLMOps contextBackground in information retrieval, NLP, or classical machine learning; or contribution to open-source AI/ML projectsWhat We OfferDirect ownership of agentic AI systems deployed across enterprise clients in 25+ countriesAccess to the latest LLM models, AI tooling, and infrastructure - with budget to experiment and shipCollaborative team of experienced AI/ML and platform engineers across the company's global delivery centersOnsite role in Bangalore with a high-growth, globally active engineering firm and a clear career growth trajectory .