Head of Quality Engineering & AI Validation

About Simplify Healthcare Simplify Healthcare is a leading HealthTech organization providing AI-powered benefits communication and digital health platform solutions to health plans, payers, and managed care organizations across the United States. Its flagship platform, Xperience1, enables member-centric experiences including benefits communication, health literacy, and claims intelligence for some of the nations largest payers. The companys mission is to simplify healthcare complexity through technology, data, and thoughtful design. Role Overview Director of Quality Assurance This is a strategic leadership role responsible for driving organization-wide quality engineering and QA transformation across multiple product lines. The Director of QA will define and execute quality strategy, strengthen QA governance, and build scalable capabilities to support the companys growth. This role combines hands-on technical leadership with strategic oversight across automation, AI model validation, QA infrastructure, and team development. You will collaborate with Engineering, Product, DevOps, and Architecture teams to embed quality across the entire SDLC within a cloud-native SaaS environment (Azure, AKS, .NET, React, Node.Js). Key Responsibilities 1. QA Strategy & Leadership Define and execute enterprise QA strategy aligned with product roadmap and compliance needs Establish quality standards, testing policies, and release readiness frameworks Build and lead a high-performing QA organization Foster a culture of shared quality ownership across teams 2. Test Automation & Engineering Design and scale automation frameworks across UI, API, integration, and performance layers Improve automation coverage and CI/CD integration Evaluate modern QA tools including AI-driven testing solutions Manage cloud-based test environments aligned with production 3. SDLC & Process Integration Embed quality gates and shift-left testing within Agile and CI/CD workflows Own release validation, regression testing, and production readiness Drive defect management, root cause analysis, and prevention strategies Establish testing standards for healthcare data and digital experiences 4. Compliance & Risk-Based Testing Ensure QA aligns with CMS, Medicare Advantage, and ACA compliance Support HIPAA, SOC 2, and HITRUST requirements in testing Implement risk-based testing strategies for critical healthcare workflows 5. AI Model Testing & Validation Define frameworks for testing AI/LLM models (accuracy, consistency, hallucination detection) Develop evaluation pipelines for AI-driven features (chatbots, search, content generation) Monitor and benchmark model performance (latency, accuracy, drift) Implement bias, fairness, and adversarial testing practices Ensure AI outputs meet compliance, clinical accuracy, and usability standards 6. Metrics & Continuous Improvement Define and track QA and AI quality KPIs Build executive dashboards and reporting frameworks Drive continuous improvement and QA maturity benchmarking Qualifications & Experience Experience 1418 years in QA / Quality Engineering 57+ years in leadership roles (Director/Head of QA) Experience scaling QA across multiple products in SaaS environments Proven track record in QA transformation initiatives Core Skills End-to-end QA strategy across functional, API, performance, and release testing Expertise in automation tools (Selenium, Playwright, Cypress, RestAssured, etc.) Experience in AI/ML and LLM testing practices Strong stakeholder management and executive communication skills Experience with CI/CD pipelines and shift-left QA approaches Preferred (Nice-to-Have) Experience building QA Center of Excellence (CoE) Healthcare/Insurance domain knowledge Understanding of FHIR, HL7, EDI, CMS programs Familiarity with AI testing tools (Ragas, DeepEval, PromptFoo, LangSmith) Experience with AKS, cloud-native environments, and performance testing tools Summary This role is ideal for a seasoned QA leader who can drive quality transformation at scale , integrate AI-driven testing practices , and build a future-ready QA organization within a high-growth HealthTech environment. About Simplify Healthcare Simplify Healthcare is a leading HealthTech organization providing AI-powered benefits communication and digital health platform solutions to health plans, payers, and managed care organizations across the United States. Its flagship platform, Xperience1, enables member-centric experiences including benefits communication, health literacy, and claims intelligence for some of the nations largest payers. The companys mission is to simplify healthcare complexity through technology, data, and thoughtful design. Role Overview Director of Quality Assurance This is a strategic leadership role responsible for driving organization-wide quality engineering and QA transformation across multiple product lines. The Director of QA will define and execute qu