Lead QA

Responsibilities: Test AI-driven products including LLMs, RAG systems, AI assistants, chatbots, and ML prediction features. Validate AI outputs for accuracy, relevance, consistency, hallucination, bias, safety, and business correctness. Test prompt behavior, system instructions, guardrails, model responses, and AI workflow quality. Work with local LLM tools such as Ollama, LM Studio, LocalAI, or similar platforms. Create AI test datasets, prompt regression suites, golden test sets, and evaluation rubrics. Perform functional, regression, integration, API, UI, database, and end-to-end testing. Build and maintain automation scripts using Selenium, Playwright, Cypress, REST Assured, PyTest, or similar tools. Use Java, Python, or JavaScript to support automation and technical validation. Validate APIs, databases, logs, and backend workflows. Use AI-powered QA tools to improve test case creation, automation support, defect analysis, and QA productivity. Identify risks, requirement gaps, and quality issues early. Work independently with minimum guidance and take ownership of assigned deliverables. Collaborate with developers, business analysts, product owners, and QA team members. Required Competencies/ Skills Bachelor's degree in computer science, Information Technology, or a related field Minimum of 7+ years of hands-on experience in manual and automation testing. 3+ years of experience testing AI, ML, LLM, chatbot, automation, or data-driven products is preferred. Good understanding of AI/ML/LLM concepts. Knowledge of RAG systems, embeddings, vector search, prompts, tokens, and hallucination risks. Hands-on experience with API testing and SQL. Automation experience using Selenium, Playwright, Cypress, REST Assured, PyTest, or similar tools. Programming knowledge in Java, Python, or JavaScript. Ability to analyze logs, troubleshoot issues, and validate backend data. Strong written and verbal communication skills. Ability to work independently and responsibly. Experience with vector databases. Demonstrate experience leading QA teams and mentoring senior and junior engineers