QA Automation Manager

As a QA Manager at our company, you will lead quality engineering initiatives for modern web applications and AI-powered products. You should have expertise in test automation using Playwright with JavaScript and a good understanding of GenAI/LLM evaluation methodologies. Your role will involve collaborating with various teams and building scalable quality processes. Key Responsibilities: - Lead and manage end-to-end Quality Assurance activities across multiple products and releases. - Define and implement QA strategies, test plans, automation frameworks, and quality standards. - Drive automation initiatives using Playwright and JavaScript for UI, API, and end-to-end testing. - Establish scalable automation practices integrated with CI/CD pipelines. - Validate and evaluate GenAI/LLM-based applications using metrics such as relevancy, faithfulness, contextual accuracy, hallucination detection, bias, and response quality. - Collaborate with cross-functional teams to ensure high-quality product delivery. - Participate in requirement discussions and provide quality-focused inputs during early development stages. - Manage defect lifecycle, root cause analysis, risk assessment, and release sign-offs. - Build and mentor high-performing QA teams while promoting a strong quality culture. - Work closely with clients and stakeholders to provide testing updates, quality reports, risk analysis, and release readiness communication. - Drive continuous improvement initiatives across testing processes, tools, and delivery practices. - Ensure application performance, reliability, security, usability, and compliance standards are met. - Track and report QA metrics, automation coverage, release quality, and operational efficiency. Required Skills & Qualifications: - Bachelors degree in Computer Science, Engineering, or related field. - 10+ years of experience in Software Testing/Quality Engineering with leadership experience. - Strong hands-on experience with Playwright and JavaScript/TypeScript automation frameworks. - Good understanding of API testing, UI testing, regression testing, and CI/CD integration. - Practical understanding of Large Language Models (LLMs), GenAI workflows, prompt validation, and AI evaluation concepts. - Experience with LLM evaluation tools/frameworks such as DeepEval or equivalent is preferred. - Excellent client-facing communication and stakeholder management skills. - Strong collaboration and cross-functional coordination abilities. - Ability to work effectively in fast-paced startup or high-growth environments. - Experience in Agile/Scrum development methodologies. - Strong analytical, problem-solving, and decision-making capabilities. In addition, the following details about the company were provided in the job description: - Ownership mindset with strong execution capabilities. - Passion for innovation and modern quality engineering practices. - Ability to balance technical depth with people leadership. - Strong focus on delivering exceptional product quality and customer experience. As a QA Manager at our company, you will lead quality engineering initiatives for modern web applications and AI-powered products. You should have expertise in test automation using Playwright with JavaScript and a good understanding of GenAI/LLM evaluation methodologies. Your role will involve collaborating with various teams and building scalable quality processes. Key Responsibilities: - Lead and manage end-to-end Quality Assurance activities across multiple products and releases. - Define and implement QA strategies, test plans, automation frameworks, and quality standards. - Drive automation initiatives using Playwright and JavaScript for UI, API, and end-to-end testing. - Establish scalable automation practices integrated with CI/CD pipelines. - Validate and evaluate GenAI/LLM-based applications using metrics such as relevancy, faithfulness, contextual accuracy, hallucination detection, bias, and response quality. - Collaborate with cross-functional teams to ensure high-quality product delivery. - Participate in requirement discussions and provide quality-focused inputs during early development stages. - Manage defect lifecycle, root cause analysis, risk assessment, and release sign-offs. - Build and mentor high-performing QA teams while promoting a strong quality culture. - Work closely with clients and stakeholders to provide testing updates, quality reports, risk analysis, and release readiness communication. - Drive continuous improvement initiatives across testing processes, tools, and delivery practices. - Ensure application performance, reliability, security, usability, and compliance standards are met. - Track and report QA metrics, automation coverage, release quality, and operational efficiency. Required Skills & Qualifications: - Bachelors degree in Computer Science, Engineering, or related field. - 10+ years of experience in Software Testing/Quality Engineering with leadersh