AI QUALITY ENGINEER

Job Description: LambdaTest is looking for an AI Quality Engineer to drive forward AI system quality by designing robust evaluation frameworks and ensuring high standards. You will be part of a mission to deprecate manual-heavy testing entirely and build the world's first AI-native platform, TestMu AI, where Agentic Intelligence autonomously plans, authors, and self-heals the entire Quality Engineering lifecycle. Key Responsibilities: - Framework Design & Implementation (50%) - Design evaluation frameworks for non-deterministic AI systems. - Implement quality standards across AI products. - Collaborate with teams to integrate evaluation tools. - Ensure scalability and reliability of testing processes. - Quality Assurance (30%) - Develop automated testing tools for AI systems. - Monitor system performance and quality metrics. - Identify and resolve quality issues proactively. - Innovation & Problem-Solving (20%) - Explore new methodologies for AI quality evaluation. - Innovate testing strategies for complex AI workflows. Qualifications Required: - Strong programming fundamentals in Python or similar language. - Experience with LLM evaluation frameworks. - Comfortable with non-determinism and reasoning in distributions. - Problem-solving skills and ability to build necessary tooling for testing. About Uplers: Uplers' goal is to make hiring reliable, simple, and fast. They aim to help all talents find and apply for relevant contractual onsite opportunities and progress in their careers. Uplers offer support for any grievances or challenges faced during the engagement. If you are ready for a new challenge, a great work environment, and an opportunity to take your career to the next level, don't hesitate to apply today. Job Description: LambdaTest is looking for an AI Quality Engineer to drive forward AI system quality by designing robust evaluation frameworks and ensuring high standards. You will be part of a mission to deprecate manual-heavy testing entirely and build the world's first AI-native platform, TestMu AI, where Agentic Intelligence autonomously plans, authors, and self-heals the entire Quality Engineering lifecycle. Key Responsibilities: - Framework Design & Implementation (50%) - Design evaluation frameworks for non-deterministic AI systems. - Implement quality standards across AI products. - Collaborate with teams to integrate evaluation tools. - Ensure scalability and reliability of testing processes. - Quality Assurance (30%) - Develop automated testing tools for AI systems. - Monitor system performance and quality metrics. - Identify and resolve quality issues proactively. - Innovation & Problem-Solving (20%) - Explore new methodologies for AI quality evaluation. - Innovate testing strategies for complex AI workflows. Qualifications Required: - Strong programming fundamentals in Python or similar language. - Experience with LLM evaluation frameworks. - Comfortable with non-determinism and reasoning in distributions. - Problem-solving skills and ability to build necessary tooling for testing. About Uplers: Uplers' goal is to make hiring reliable, simple, and fast. They aim to help all talents find and apply for relevant contractual onsite opportunities and progress in their careers. Uplers offer support for any grievances or challenges faced during the engagement. If you are ready for a new challenge, a great work environment, and an opportunity to take your career to the next level, don't hesitate to apply today.