AI Testing / Model Validation Specialist

About LetitbexAI LetitbexAI is a fast-growing AI-driven technology company focused on building intelligent, scalable, and enterprise-grade solutions. We work at the intersection of AI, data engineering, cloud, and business transformation, helping organizations unlock real value from artificial intelligence. Position: AI Testing / Model Validation Specialist Experience: 3-5 Years Notice Period: Can be considered up 15 Days Role Summary Develop and execute comprehensive testing strategies for AI-powered features in various modules. Ensure quality, reliability, and ethical soundness of AI components. Key Responsibilities Develop test plans and strategies for AI-powered recruitment features Design test datasets and evaluation suites for model validation Execute functional and performance testing of AI components Conduct fairness and bias testing on AI-driven decisions Implement automated testing frameworks for ML models Perform edge case and adversarial testing Create dashboards and reports on AI feature quality metrics Collaborate with ML engineers on model improvement recommendations Document known limitations and edge cases Support A/B testing and champion-challenger evaluations Required Skills & Experience 3-5 years of QA experience with exposure to AI/ML products Understanding of ML concepts, evaluation metrics, and testing methodologies Strong analytical skills and attention to detail Proficiency in Python or similar language for test automation Experience with test automation frameworks and tools Knowledge of statistical testing and data analysis Strong communication and documentation abilities Nice to Have Experience with fairness and bias evaluation frameworks Knowledge of NLP and language model testing Familiarity with ML evaluation platforms or tools Experience with automated testing for ML systems SQL knowledge for data exploration