Source description
About the role
We are looking for a Senior Software Engineer to join a team building a comprehensive platform designed to evaluate Large Language Model performance and provide inference endpoints for Generative AI applications at enterprise scale. The platform enables stakeholders to systematically assess, compare, and select the most suitable LLMs for use cases, including natural language processing, customer service automation, content generation, and data analysis. It routes, secures, and governs LLM inference across multiple model providers. In this role, you will design and build scalable, production-ready backend systems using Go in a microservices architecture. You will own critical backend services, integrate with external LLM providers, and ensure reliability, performance, and security at scale. The project is in its initial strategic phase — defining personas, mapping user journeys, designing UX, and establishing a development roadmap with epics and user stories to guide future investment. This is a high-impact engineering role requiring independent execution, technical leadership, and cross-functional collaboration in ambiguous problem spaces.
More at EPAM Systems
Related open roles
Java Full-Stack Developer (Angular) - Hyderabad
Hyderabad · Hybrid
Java Full-Stack Developer (Angular) - Hyderabad
Hyderabad · Hybrid
Senior Java Full-Stack Developer (Angular)
Bangalore · Hybrid
Java Full-Stack Developer (Angular)
Bangalore · Hybrid
Data Technology Consultant
Mumbai
Senior Data Software Engineer
Mumbai