Padmi

Gen AI LLMOps Engineer (Karnataka)

IndiaPosted 1 month ago
Software engineeringJuniorFull Time; Regular
Apply at Infosys

Opens the source posting on shine.com

Source description

About the role

View original

Educational Requirements Bachelor of Engineering,BTech,BCA,BSc,MCA,MTech,MSc Service Line Data Analytics Unit Responsibilities - LLM Deployment ProductionizationDeploy and manage LLMs (OpenAI, Llama, Mistral, etc.) in production environmentsBuild scalable inference pipelines (real-time batch)Integrate LLMs into applications via APIs and microservicesLLMOps / GenAI Pipeline DevelopmentDesign and implement end-to-end LLM pipelines:Prompt engineeringRetrieval-Augmented Generation (RAG)Fine-tuning / embeddingsWork with frameworks like:LangChain, LangGraph, LlamaIndexRAG Data IntegrationBuild and optimize RAG pipelines using vector databasesWork with tools like:Pinecone, FAISS, Weaviate, ChromaHandle document ingestion, chunking, indexing, and retrievalModel Monitoring OptimizationMonitor LLM performance:LatencyAccuracy / hallucinationsCost efficiencyImplement:Prompt optimizationFeedback loopsGuardrails evaluation frameworksMLOps for LLMsBuild CI/CD pipelines for:Model updatesPrompt/version controlManage experiment tracking and deploymentsEnsure reproducibility of LLM workflows Additional Responsibilities: - What This Role Is NOT Not pure:Data Scientist (model building only)Platform Engineer (infra-heavy role)Traditional MLOps without LLM exposure This role focuses on:LLM deployment + RAG + GenAI pipelinesOperationalizing GenAI applications Technical and Skilled Requirements: - Strong Python programming - Hands-on experience with LLMs / Generative AI - Experience with:LangChain / LangGraph / LlamaIndex - Solid understanding of:RAG architecture - Prompt engineering - Embeddings vector search - Experience building APIs using:FastAPI / Flask Preferred Skills: - Technology->AI-Generative AI->Generative AI for Data Analytics .

One address, no account. We’ll tell you when matching roles go live.

More at Infosys

Related open roles

View all roles