Source description
About the role
Must Have Technical/Functional Skills
• AI/ML/LLM Quality Engineering experience (testing, validation, evaluation frameworks)
• Expertise in AI evaluation methods (deterministic & non-deterministic systems)
• Validation frameworks, golden datasets, and test harness
• Scalable testing strategies for enterprise AI platforms
• Experience embedding quality practices into AI SDLC / delivery lifecycle
• Model evaluation, monitoring, and continuous quality improvement
• Agent/LLM evaluation and autonomy threshold
• Cross-functional collaboration with engineering, data, and architecture ________________________________________
Roles & Responsibilities
• Build the AI QA function as a dedicated capability within the broader AI delivery organization.
• Define quality engineering practices for AI systems, including evaluation methods for deterministic and non-deterministic outputs.
• Develop, adopt AI for QE capabilities and improve outcomes of the Quality Engineering function using new AI capabilities
• Establish validation criteria, golden datasets, and test harnesses to support safe deployment and continuous model or prompt changes.
• Work with engineering and synthetic data teams to ensure quality controls are embedded into the AI delivery lifecycle.
• Establish baseline KPIs for QE function and incorporate mechanism to track maturity
• Help define thresholds for agent maturity and autonomy, including when systems can move from analysis to decision and action under appropriate oversight.
Salary Range: $130,000- $150,000 a year
TCS Employee Benefits Summary:
Discretionary Annual Incentive.
Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
Family Support: Maternal & Parental Leaves.
Insurance Options: Auto & Home Insurance, Identity Theft Protection.
Convenience & Professional Growth: Commuter Benefits & Certification & amp; Training Reimbursement.
Time Off: Vacation, Time Off, Sick Leave & Holidays.
Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
#LI-SP1
Role: Lead
Desired skills: Artificial Intelligence | Machine Learning
Qualifications: BACHELOR OF COMPUTER SCIENCE
-
Experience: 8 - 20 Years
-
Job function: TECHNOLOGY
-
Location: Chicago, IL
Salary range: $130,000–$150,000
Apply by: 2026-08-03 00:00:00
More at Tata Consultancy Services