AI Quality Engineer

Unlock your potential with Dassault Systèmes, a global leader in Scientific Software Engineering, as we are hiring an AI Quality Engineer in Kuala Lumpur, Malaysia! Join us in building a next-generation AI Virtual Companion for Operation Planning & Optimization. Powered by Large Language Models (LLMs) and agentic AI, you'll help create intelligent systems that can reason, retrieve information, and act autonomously. Role Responsibilities & Job Description: Prompt Engineering & Evaluation: Design and execute sophisticated test cases using prompt injection and adversarial testing to evaluate the AI’s boundaries and responses. LLM Benchmarking: Utilize advanced frameworks to measure performance in critical areas like hallucination rates, sentiment consistency, and context retention. Automated Validation: Build and maintain automated pipelines that leverage "LLM-as-a-judge" patterns to evaluate model outputs at scale. Safety & Bias Auditing: Lead "Red Teaming" sessions to identify potential biases, toxic content, or PII (Personally Identifiable Information) leaks. Regression Testing: Manage the evaluation of model performance across different versions to ensure seamless upgrades and stability. Collaboration & Delivery: Work with Product Owner, Developers, AI Engineers and UX Designers to deliver the Virtual Companion. Contribute to sprint planning, code reviews and documentation. Requirements & Qualifications: Bachelor’s degree or above, with 2-5 years in software development and relevant experience specifically within the AI/ML development landscape. AI/ML Literacy: A strong grasp of LLM fundamentals, including tokens, temperature, top-p, and context windows. Programming: Proficiency in Python. API Testing: Expertise in testing RESTful APIs and WebSocket connections for real-time AI interactions.