Source description
About the role
Job Description Principal Engineer (Proven experience with Python, PyTest, AI/ML Test Engineering-Validating AI/ML models, LLM-powered applications, RAG pipelines, and inference services.) Role We are looking for an exceptional Principal Automation Test Engineer with deep expertise in Python, PyTest, API automation, and AI/ML platform testing. The ideal candidate has built scalable automation frameworks, validated ML models and data pipelines, and has hands-on experience ensuring quality across modern AI-powered applications. Key Responsibilities - Design and build scalable test automation frameworks using Python and PyTest. - Develop automated tests for REST APIs, microservices, and distributed systems. - Validate AI/ML models, LLM-powered applications, RAG pipelines, and inference services. - Create automated testing for data quality, feature engineering, and ML pipelines. - Build regression, integration, end-to-end, performance, and reliability test suites. - Implement CI/CD quality gates and automated test execution. - Collaborate with software, platform, ML, and DevOps engineers throughout the SDLC. - Drive shift-left testing and improve engineering quality practices. - Perform root cause analysis and improve system reliability. Required Skills - 10+ years of SDET or Test Engineering experience. - Expert-level Python programming. - Solid hands-on experience with PyTest. - Experience testing REST APIs using Requests, FastAPI, or similar frameworks. - Experience with Selenium or Playwright (UI automation). - API testing using Postman or automated frameworks. - Strong SQL and database validation. - Experience with Git, Docker, and Linux. - CI/CD using Jenkins, GitHub Actions, GitLab CI, or similar. - Experience testing cloud-native applications on AWS, Azure, or GCP. AI/ML Test Engineering (Must Have) - Testing AI/ML applications and production ML systems. - Validation of ML model accuracy, precision, recall, F1, and drift. - Experience testing: - LLM applic .
More at Anaplan