AI Test Engineer

AI Test Engineer Insurance We are looking for a QA/Test Engineer with strong functional testing experience and hands-on exposure to AI/LLM application testing within the insurance domain. Key Responsibilities Design, develop, and execute test cases for AI/LLM-based applications. Validate AI outputs for accuracy, relevance, consistency, safety, and business compliance. Develop prompts and evaluation scenarios to test AI responses against expected outcomes. Perform functional, regression, integration, and user acceptance testing for AI-enabled applications. Identify defects, analyze AI behavior, and work with developers to improve model performance. Document test strategies, test cases, results, and defect reports. Required Skills 3+ years of software testing experience with strong functional testing expertise. Hands-on experience testing GenAI/LLM applications (commercial or internal projects). Experience creating AI test cases, evaluation datasets, prompts, and expected outputs. Working knowledge of AI evaluation concepts such as hallucination detection, prompt validation, response quality, bias, and safety testing. Exposure to one or more AI testing frameworks/tools such as DeepEval, Promptfoo, Garak, or similar. Strong analytical and communication skills as well as team player Preferred Qualifications Experience with Health Insurance or Agency Operations testing is highly Preferred Basic Python scripting for AI testing is an advantage. Experience working in Agile/Scrum teams.