Source description
About the role
Job Description Principal Engineer (Proven experience with Python, PyTest, AI/ML Test Engineering-Validating AI/ML models, LLM-powered applications, RAG pipelines, and inference services.) Role We are looking for an exceptional Principal Automation Test Engineer with deep expertise in Python, PyTest, API automation, and AI/ML platform testing. The ideal candidate has built scalable automation frameworks, validated ML models and data pipelines, and has hands-on experience ensuring quality across contemporary AI-powered applications. Key Responsibilities Design and build scalable test automation frameworks using Python and PyTest. Develop automated tests for REST APIs, microservices, and distributed systems. Validate AI/ML models, LLM-powered applications, RAG pipelines, and inference services. Create automated testing for data quality, feature engineering, and ML pipelines. Build regression, integration, end-to-end, performance, and reliability test suites. Implement CI/CD quality gates and automated test execution. Collaborate with software, platform, ML, and DevOps engineers throughout the SDLC. Drive shift-left testing and improve engineering quality practices. Perform root cause analysis and improve system reliability. Required Skills 10+ years of SDET or Test Engineering experience. Expert-level Python programming. Solid hands-on experience with PyTest. Experience testing REST APIs using Requests, FastAPI, or similar frameworks. Experience with Selenium or Playwright (UI automation). API testing using Postman or automated frameworks. Robust SQL and database validation. Experience with Git, Docker, and Linux. CI/CD using Jenkins, GitHub Actions, GitLab CI, or similar. Experience testing cloud-native applications on AWS, Azure, or GCP. AI/ML Test Engineering (Must Have) Testing AI/ML applications and production ML systems. Validation of ML model accuracy, precision, recall, F1, and drift. Experience testing: LLM applic .
More at Anaplan