Padmi

Gen Ai/llm Engineer 5+yrs Pune (India)

MumbaiPosted 1 month ago
Software engineeringSeniorFull Time; Regular
Apply at Zorba AI

Opens the source posting on shine.com

Source description

About the role

View original

Job Description A leading consulting firm operating in the Enterprise Generative AI and Large Language Model (LLM) services sector, delivering production-grade LLM solutions, retrieval-augmented systems, and custom generative AI products for enterprise clients across domains. The team focuses on building secure, scalable, low-latency inference services and automating model lifecycle workflows for on-prem and cloud deployments. Position: LLM Engineer In office (India). We are hiring an experienced LLM engineer to design, fine-tune, and deploy LLM-based solutions that power search, summarization, agents, and domain-specific assistants. Role & Responsibilities Design, fine-tune, and validate LLMs for production use-casesinstruction tuning, supervised fine-tuning, and parameter-effective tuning (LoRA/adapters). Implement retrieval-augmented generation (RAG) pipelines: embeddings, vector search, chunking, and context assembly for high-recall responses. Optimize inference for latency and cost: quantization, model pruning, batching, and deployment with optimized runtimes (CUDA, Triton, bitsandbytes where applicable). Build backend services and APIs to serve LLM inference and orchestration using containerized deployments (Docker/Kubernetes) and CI/CD pipelines. Collaborate with product, data engineering, and ML teams to integrate LLMs into production flows, monitor model performance, and set up automated retraining/rollbacks. Create reproducible training pipelines, implement evaluation suites, and produce documentation and runbooks for model governance and observability. Skills & Qualifications Must-Have 4+ years of hands-on experience working with LLMs or advanced NLP models in production contexts. Proficiency in Python for ML engineering and model development. Experience with PyTorch and Hugging Face Transformers for training and fine-tuning. Practical experience implementing RAG and vector search using tools like FAISS or similar vector databases .

One address, no account. We’ll tell you when matching roles go live.

More at Zorba AI

Related open roles

View all roles