QA AI Tester

Job Title: QA AI Tester Location: Hyderabad, India Experience: 8+ Years Shift : 2:00 PM - 11:00 PM Role Overview We are looking for an experienced QA AI Tester to drive quality assurance strategies for AI/ML-driven systems. This role goes beyond traditional UI/API testing and focuses on validating machine learning models, large language models (LLMs), and data pipelines. You will play a critical role in ensuring reliability, fairness, and performance of AI-powered solutions. Key Responsibilities Lead end-to-end QA strategy for AI/ML and data-driven systemsDesign and implement test frameworks for ML model validation and evaluationPerform LLM testing, including prompt evaluation, response validation, and bias detectionValidate data pipelines (ETL) for data quality, consistency, and integrityBuild and maintain automation frameworks using PythonDefine test datasets, benchmarks, and evaluation metrics for AI modelsCollaborate with data scientists, ML engineers, and product teamsIdentify risks related to model drift, bias, and performance degradationImplement continuous testing practices in CI/CD pipelinesEnsure compliance with quality, ethical AI, and governance standardsRequired Skills & Qualifications 8+ years of experience in QA, with strong exposure to AI/ML systemsHands-on experience in ML model testing and validation techniquesStrong understanding of LLMs and prompt engineering/testing methodologiesExperience with data validation and pipeline testingProficiency in Python for test automationKnowledge of statistical analysis and model evaluation metricsExperience working in Agile/Scrum environmentsPreferred Qualifications Experience with tools like Evidently AI, DeepChecks, or similar ML monitoring/testing frameworksFamiliarity with MLOps practices and toolsExposure to cloud platforms (AWS, Azure, or GCP)Understanding of AI ethics, bias detection, and explainabilityLeadership Expectations Mentor QA teams on AI testing practicesDrive innovation in AI quality engineeringEstablish best practices and standards for AI testing .