AI Orchestration Engineer

Company Description Trusty Bytes is an IT services and consulting company based in India, partnering with global clients to enhance business value through custom software development, technology consulting, and digital reliability services. The company delivers dependable and scalable solutions across personalized software development, AI solutions, managed services, and automation. Trusty Bytes emphasizes clarity, reliability, and fast execution, targeting measurable outcomes such as performance, stability, cost optimization, and speed to market. Systems are designed with reliability, observability, and maintainability as core principles, supported by a strong focus on both customer and employee experience. Founder-led engagement and a culture of trust, transparency, and accountability enable long-term, people-centric partnerships. We have an opening for one of our customer for Bangalore location (Hybdrid Mode) Job Description : We are looking for an AI Orchestration Engineer with 5+ years to design, build, and optimize intelligent workflows that coordinate large language models, retrieval systems, tools, APIs, and enterprise services into reliable AI applications. This role is ideal for a hands-on engineer who can work across orchestration frameworks, backend services, and AI integration layers to deliver scalable, secure, and production-ready solutions. The ideal candidate should have strong experience in LLM orchestration, agent workflows, RAG pipelines, prompt and context management, API integration, and cloud-based AI services. The role requires someone who can turn business requirements into robust orchestration logic while ensuring quality, observability, performance, and governance. Required Skills: Strong hands-on experience in AI orchestration / LLM application engineering Strong programming experience in Python Experience with LangChain, LangGraph, or similar orchestration frameworks Experience in designing and implementing RAG pipelines Good understanding of LLMs, prompt engineering, embeddings, semantic retrieval, and vector search Experience with vector databases such as Pinecone, Chroma, Qdrant, FAISS, or similar Experience building APIs and backend services using FastAPI, Node.js, or similar frameworks Strong knowledge of workflow design, agentic patterns, tool calling, and context management Experience integrating AI services with enterprise APIs, databases, and business systems Good understanding of model response evaluation, orchestration performance tuning, and fallback strategies Familiarity with cloud AI platforms such as Azure OpenAI, AWS Bedrock, OpenAI API, or similar Knowledge of observability, monitoring, and debugging for AI systems Strong problem-solving, communication, and collaboration skills Good to Have: Experience with multi-agent systems Exposure to LLMOps / MLOps Familiarity with Docker, Kubernetes, CI/CD, and cloud-native deployment practices Experience with PostgreSQL, Redis, message queues, or event-driven architectures Knowledge of security, guardrails, responsible AI, and governance controls Experience in building enterprise copilots, AI assistants, or document intelligence platforms Company Description Trusty Bytes is an IT services and consulting company based in India, partnering with global clients to enhance business value through custom software development, technology consulting, and digital reliability services. The company delivers dependable and scalable solutions across personalized software development, AI solutions, managed services, and automation. Trusty Bytes emphasizes clarity, reliability, and fast execution, targeting measurable outcomes such as performance, stability, cost optimization, and speed to market. Systems are designed with reliability, observability, and maintainability as core principles, supported by a strong focus on both customer and employee experience. Founder-led engagement and a culture of trust, transparency, and accountability enable long-term, people-centric partnerships. We have an opening for one of our customer for Bangalore location (Hybdrid Mode) Job Description : We are looking for an AI Orchestration Engineer with 5+ years to design, build, and optimize intelligent workflows that coordinate large language models, retrieval systems, tools, APIs, and enterprise services into reliable AI applications. This role is ideal for a hands-on engineer who can work across orchestration frameworks, backend services, and AI integration layers to deliver scalable, secure, and production-ready solutions. The ideal candidate should have strong experience in LLM orchestration, agent workflows, RAG pipelines, prompt and context management, API integration, and cloud-based AI services. The role requires someone who can turn business requirements into robust orchestration logic while ensuring quality, observability, performance, and governan