Source description
About the role
About the Role Location : Electronic city, Bangalore We operate a growing portfolio of purpose-built AI agents serving engineering, commercial, and operational teams in Asia Pacific - spanning various industries. As our AI Agent Deployment & QA Engineer, you will be the operational backbone of our Agent Factory: deploying, testing, maintaining, and scaling agents across the business. No domain expertise required - what matters is fluency in enterprise AI agent platforms, structured QA thinking, and the ability to keep agents accurate and continuously improving. Key Responsibilities Deploy and configure AI agents on enterprise platforms (e.g. Microsoft Copilot Studio, Azure AI Foundry, or equivalent) - system instructions, knowledge base (KB) files, topic flows, connectors, and multi-agent orchestration Manage KB file architecture, versioned updates, licensing, and environment provisioning Design and execute structured test plans covering prompt coverage, edge cases, hallucination checks, and retrieval accuracy; maintain QA logs and run regression testing after every update Collect and triage user feedback; translate into change requests and coordinate KB updates with domain knowledge owners Maintain the agent registry (version history, owner, deployment status, KB sources) and support governance standards Drive rollout of agents to new users, teams, and geographies; produce onboarding documentation and user guides Required Qualifications 5-10 years in software/platform deployment, technical operations, or QA roles Hands-on experience with one or more enterprise AI agent platforms (e.g. Microsoft Copilot Studio, Azure AI Foundry, AWS Bedrock Agents, or equivalent) - mandatory Cloud platform administration knowledge (Microsoft 365 / Azure or equivalent); identity and access management Familiarity with prompt engineering and LLM behaviour (grounding, retrieval, hallucination) Basic REST API / JSON integration exposure; version control awareness Detail-oriented, self-directed, and comfortable working with non-technical domain experts across time zones Preferred Microsoft certifications (PL-100, PL-200, PL-600, AI-102) or equivalent cloud AI credentials Familiarity with Azure AI services (Azure OpenAI, AI Search) or equivalent Background in system integration, technology consulting, or industrial sectors (Oil & Gas, Marine, Energy, Data Centres) Why Join Us Work on production-grade industrial AI - real deployments, not pilots Build deep expertise across enterprise agent platforms in a structured, multi-vertical programme Be part of a team designing what AI-native industrial services look like at scale
More at Siemens
Related open roles
Lead Software Test Engineer - Marcom, Sales and Delivery Services (Bengaluru)
Bangalore
Senior Software Test Engineer
Bangalore
Quality Professional
Bangalore
Test Automation Engineer Playwright & Smart Buildings
Mumbai
Test Automation Engineer Playwright & Smart Buildings (Pune)
Mumbai
Lead Test Engineer - Electrification
Bangalore