Source description
About the role
Build and maintain end-to-end validation plans and operational test strategies for agentic AI workflows across local tools, edge-deployed models, MCP services, and external mission systems.
Develop and execute regression test suites supporting prompt updates, model changes, MCP server modifications, X9 Spider hardware and firmware updates, workflow revisions, and published agent releases.
Define and document pass/fail criteria for operational AI workflows, including correctness, reliability, safety, latency, explainability, usability, and mission effectiveness.
Validate guardrails, operational boundaries, tool-use behavior, and workflow reliability under adversarial, malformed, degraded, and realistic field-operational input conditions.
Execute workflow acceptance testing and operational validation activities on the X9 Spider Mission Computer and related edge-compute platforms.
Capture, organize, and maintain validation evidence, test results, issue tracking, operational observations, and supporting artifacts required for customer review, accreditation, and signoff activities.
Collaborate with AI engineers, integration teams, and operational stakeholders to identify workflow deficiencies, troubleshoot failures, and support corrective actions or workflow improvements.
Validate workflow interoperability across AI agents, edge models, MCP services, reporting systems, mission applications, and operational command environments.
Support operational demonstrations, field exercises, user evaluations, and mission rehearsal activities involving AI-enabled workflows and edge-compute systems.
Train operational users and customer personnel on the effective use of AI agents and workflows in field environments, including workflow execution, output interpretation, operational limitations, troubleshooting basics, and uncertainty escalation procedures.
Develop quick-reference guides, workflow playbooks, field-user instructions, troubleshooting aids, and operational support materials tailored for mission users and technical administrators.
Establish and maintain user feedback mechanisms and operational reporting processes for capturing workflow deficiencies, inaccurate outputs, usability concerns, and missing operational capabilities.
Support DevSecOps, release validation, and operational readiness activities associated with deployment and sustainment of AI-enabled workflows and edge-compute applications.
More at NextGen Federal Systems