Source description
About the role
LLM Systems Engineer – Intelligent Platform Integration
Experience: 5–8 years
Reporting To: Principal Backend Architect
Role Overview
This role focuses on the engineering and orchestration of large language model (LLM) platforms within enterprise-grade systems.
The position emphasizes reliability, consistency, and operational control, rather than prompt design alone.
Key Responsibilities:
• Design and maintain a multi-model orchestration framework supporting multiple LLM providers.
• Implement systems for: o Parallel execution and failover handling o Response normalization and validation o Confidence and consistency checks
• Enforce structured outputs through schema validation and error handling.
• Monitor and optimize cost, performance, and accuracy trade-offs.
• Collaborate with backend, QA, and analytics teams to integrate intelligence outputs into production workflows.
Required Qualifications:
• Hands-on experience integrating multiple LLM APIs.
• Strong understanding of structured data validation, JSON schemas, and API error handling.
• Experience building resilient systems handling partial or degraded responses.
• Analytical mindset with focus on reliability and correctness
More at TK-Chain