Source description
About the role
Design comprehensive test architecture – plan unit, integration, E2E, and semantic validation test suites that cover the full pipeline from profile intake through roadmap generation; define coverage targets and acceptance criteria
Build semantic validation harnesses for AI outputs – design golden-set test cases (5–8 CISO-approved reference profiles) that measure AI stage precision/recall, rigor-tier correctness, floor-control invariants, traceability completeness, and run-to-run stability; a semantic regression blocks merge
Implement access-control testing – design automated probes at API and database layers that verify cross-tenant isolation; simulate compromised sessions and verify RLS policies enforce tenant boundaries
Design and maintain CI/CD quality gates – build automated test runners that execute on every commit: unit tests, integration tests, schema validation, migration guards, image scanning, access-control probes; red builds block merge
Lead test automation practices – expand automation frameworks and practices; identify opportunities for improving test processes; recommend tools and technologies for testing efficiency
Collaborate across the team – serve as the QA voice in technical design reviews; flag testability issues early; work with the AI/LLM Lead to define what "correct" means for each pipeline stage
Mentor junior test engineers – guide the team on test design, semantic validation, and CI/CD best practices; share knowledge on testing AI systems where reproducibility is critical
Own test documentation and reporting – maintain clear test plans, results, and traceability matrices; report test coverage and quality metrics to leadership; communicate blockers and risks transparently
More at 3Pillar
Related open roles
AWS Snowflake Data Architect (12+ Years of Exp+ Immediate Joiners Preferred)
Remote · India
Senior Software Engineer - Java & Angular
Remote · Mumbai · Chennai
AI Lead Engineer (Prompt Engineering, RAG and LLM's)
Remote · IN
Software Architect (Python, AWS, AI)
Remote · CR
Senior QA Automation Engineer (Python | Selenium | Pytest)
Remote · Costa Rica
Senior QA Automation Engineer - Java / Selenium / AWS
Remote · Mexico
