Padmi

AI Agent Deployment- QA Engineer

BangalorePosted 1 month ago
Software QualitySenior
Apply at Siemens

Opens the source posting on naukri.com

Source description

About the role

View original

About the Role Location : Electronic city, Bangalore We operate a growing portfolio of purpose-built AI agents serving engineering, commercial, and operational teams in Asia Pacific - spanning various industries. As our AI Agent Deployment & QA Engineer, you will be the operational backbone of our Agent Factory: deploying, testing, maintaining, and scaling agents across the business. No domain expertise required - what matters is fluency in enterprise AI agent platforms, structured QA thinking, and the ability to keep agents accurate and continuously improving. Key Responsibilities Deploy and configure AI agents on enterprise platforms (e.g. Microsoft Copilot Studio, Azure AI Foundry, or equivalent) - system instructions, knowledge base (KB) files, topic flows, connectors, and multi-agent orchestration Manage KB file architecture, versioned updates, licensing, and environment provisioning Design and execute structured test plans covering prompt coverage, edge cases, hallucination checks, and retrieval accuracy; maintain QA logs and run regression testing after every update Collect and triage user feedback; translate into change requests and coordinate KB updates with domain knowledge owners Maintain the agent registry (version history, owner, deployment status, KB sources) and support governance standards Drive rollout of agents to new users, teams, and geographies; produce onboarding documentation and user guides Required Qualifications 5-10 years in software/platform deployment, technical operations, or QA roles Hands-on experience with one or more enterprise AI agent platforms (e.g. Microsoft Copilot Studio, Azure AI Foundry, AWS Bedrock Agents, or equivalent) - mandatory Cloud platform administration knowledge (Microsoft 365 / Azure or equivalent); identity and access management Familiarity with prompt engineering and LLM behaviour (grounding, retrieval, hallucination) Basic REST API / JSON integration exposure; version control awareness Detail-oriented, self-directed, and comfortable working with non-technical domain experts across time zones Preferred Microsoft certifications (PL-100, PL-200, PL-600, AI-102) or equivalent cloud AI credentials Familiarity with Azure AI services (Azure OpenAI, AI Search) or equivalent Background in system integration, technology consulting, or industrial sectors (Oil & Gas, Marine, Energy, Data Centres) Why Join Us Work on production-grade industrial AI - real deployments, not pilots Build deep expertise across enterprise agent platforms in a structured, multi-vertical programme Be part of a team designing what AI-native industrial services look like at scale

One address, no account. We’ll tell you when matching roles go live.

More at Siemens

Related open roles

View all roles