Principal Quality Assurance Engineer (Automation)

Deltek is seeking a skilled specialized Automation Engineer with expertise in testing and test automation of AI-powered workflows and intelligent features across ERP product lines . This role blends traditional ERP quality engineering with next-gen AI validation , ensuring that embedded AI capabilities are accurate, safe, compliant, explainable, and scalable . The ideal candidate needs strong ERP domain knowledge, hands-on automation expertise, and understands how to evaluate LLM-driven responses, predictive analytics, recommendations, and AI decision support outputs . This role requires a detail-oriented individual who can work collaboratively with cross-functional teams to ensure the delivery of high-quality ERP solutions. Responsibilities Develop end-to-end test strategy for AI features across ERP modules such as Finance, Supply Chain, Projects, HR, and Payroll Execute functional, regression, scenario-based, and exploratory testing for AI-enhanced workflows Validate AI/ML outputs including: Prediction accuracy scoring Recommendation relevance Natural-language responses Behavior consistency across edge cases Create and maintain automation suites for UI/API and AI validations Design AI safety test cases hallucination detection, bias testing, ethical and compliance alignment Collaborate with Product Managers, AI/ML engineers , SMEs, and Developers to define release quality gates Ensure test coverage of data pipelines : input validation, data sampling, transformations, and output visualizations Contribute to performance, scalability data-drift testing of AI features in ERP contexts Maintain test documentation test plans, test cases, defect logs, and sprint reports Drive automation adoption in CI/CD pipelines for AI-enabled releases Provide mentorship to senior engineers and teams, guiding best practices and fostering professional development. "," Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.