JPC - 206467 - SDET

Job Summary: SDET (Software Development Engineer in Test) – Conversational AI | Hybrid – Hartford, CT or Wellesley, MA | 6-Month CTH

[About the Role] Join the YAVA Engineering team at CVS, where you’ll play a pivotal role in shaping the future of conversational AI that powers millions of customer interactions across voice and chat channels. As an SDET, you’ll embed directly with developers, driving the design and implementation of robust automation and test strategies for the Your Aetna Virtual Assistant platform. This is a hands-on engineering position, offering significant leadership, technical ownership, and the chance to mentor junior resources—all while working on a cutting-edge, high-impact product.

[Responsibilities]

• Architect, design, and implement advanced test automation frameworks for conversational AI, including API, backend, and end-to-end scenarios
• Develop and maintain test harnesses for validating multi-turn conversations, intent recognition, and orchestration logic in voice and chat
• Collaborate closely with Product, Engineering, and Architecture teams to define test strategy, coverage goals, and acceptance criteria
• Mentor and lead junior engineers in automation best practices, test-driven development, and use of test harnesses
• Identify testing gaps, recommend robust solutions, and ensure platform changes enhance customer experience
• Build and maintain reusable documentation, examples, and guides to streamline test implementation for the team
• Contribute to sprint work, pair with developers on complex scenarios, and actively support continuous integration and deployment pipelines
• Monitor, report on, and improve quality and test metrics, upholding high standards for platform reliability and performance

[Required Skills and Experience]

• 5+ years software engineering experience, with a minimum of 3 years focused on test automation/SDET roles
• Advanced proficiency in Java and Node.js, with object-oriented design experience
• Hands-on expertise in Selenium, Playwright, and modern API testing tools (Bruno, Rest Assured, Karate, Postman)
• Demonstrated experience with conversational AI, AI agents, or testing LLM/AI responses
• Strong background in designing, building, and maintaining custom automation frameworks and test data strategies
• Experience across full-stack testing: APIs, backend, and frontend layers
• Solid understanding of CI/CD pipeline automation (GitHub Actions or equivalent)
• Excellent communication skills for documentation, mentoring, and articulating testing strategies
• Onsite availability for hybrid work in Hartford, CT or Wellesley, MA

[Preferred Skills]

• Extensive hands-on experience with Bruno for API testing
• Previous work with contract testing, API mocking tools, performance/load testing frameworks
• Deep technical expertise in automation for conversational AI platforms

[Benefits]

• Opportunity to lead, mentor, and influence a high-impact engineering team on a next-generation AI platform
• Work with the latest automation tools and AI technologies
• Hybrid onsite work model for strong team collaboration and work-life balance
• Potential for contract-to-hire and long-term career growth within a Fortune 5 organization

[How to Apply]

Ready to transform conversational AI and play a key engineering role at CVS? Submit your application today to join a forward-thinking team driving innovation at scale.