Padmi

Senior QE

BangalorePosted 2 months ago
Software QualitySeniorFull Time; Regular
Apply at Arctic Wolf

Opens the source posting on shine.com

Source description

About the role

View original

Responsibilities: Create and extend software frameworks and tools to run, monitor, and report on automated tests. Have experience building and maintaining Automation frameworks and CI/CD pipeline.Review testing strategies, approaches, and test plans and provide insight to development teams.Architect, design and build software to automate a variety of testing methods (e. g. API validation, performance/load testing, fuzzing, etc. )Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection, and regression testing for AI inference APIs.Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability.Work as part of a team of highly skilled software professionals.Continuously learn and expand your technical horizonsOur Technology Stack: Selenium, Playwright, Docker, Kubernetes, AWS (Bedrock, Lambda, SQS, S3 etc. ), LangChain, LLM evaluation frameworks (e. g., Ragas), OpenAPI, Postgres, Linux. Requirements: Are excited to work at the intersection of AIML, Big Data and the Cybersecurity problem space.Have 5+ years of experience shipping quality software.Love driving high software quality.Have experience deploying services on cloud computing platforms (e. g, AWS, Azure, GCP).Are an expert using common tools for executing functional, load and fuzz testing (e. g. Locust, CATS).Have worked on distributed systems and microservices architecture (preferred). Responsibilities: Create and extend software frameworks and tools to run, monitor, and report on automated tests. Have experience building and maintaining Automation frameworks and CI/CD pipeline.Review testing strategies, approaches, and test plans and provide insight to development teams.Architect, design and build software to automate a variety of testing methods (e. g. API validation, performance/load testing, fuzzing, etc. )Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection, and regression testing for AI inference APIs.Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability.Work as part of a team of highly skilled software professionals.Continuously learn and expand your technical horizonsOur Technology Stack: Selenium, Playwright, Docker, Kubernetes, AWS (Bedrock, Lambda, SQS, S3 etc. ), LangChain, LLM evaluation frameworks (e. g., Ragas), OpenAPI, Postgres, Linux. Requirements: Are excited to work at the intersection of AIML, Big Data and the Cybersecurity problem space.Have 5+ years of experience shipping quality software.Love driving high software quality.Have experience deploying services on cloud computing platforms (e. g, AWS, Azure, GCP).Are an expert using common tools for executing functional, load and fuzz testing (e. g. Locust, CATS).Have worked on distributed systems and microservices architecture (preferred).

One address, no account. We’ll tell you when matching roles go live.

More at Arctic Wolf

Related open roles

View all roles