Padmi
Braintrust logo
Braintrust

AI observability · LLM evaluation

Principal AI Research Scientist / Applied AI Consultant

IndiaPosted 1 month ago
Computer ResearchStaff+Full Time; Regular
Apply at Braintrust

Opens the source posting on shine.com

Source description

About the role

View original

A leading AI lab is expanding its roster of expert contributors, and Braintrust is helping identify senior experts for this advisory role. As a Principal AI Research Scientist / Applied AI Consultant, you will serve as the technical authority for highly complex AI projects, providing expertise on model behavior, benchmarking methodologies, synthetic-data strategies, evaluation systems, and emerging AI capabilities. You will work with program leadership and client stakeholders to assess feasibility, review methodologies, and shape how advanced AI systems are evaluated and improved. This is a remote, flexible engagement contributing to frontier AI work. Responsibilities Technical advisory: participate in solution discussions, assess project feasibility, review methodologies, and recommend evaluation approaches.Benchmark design: create benchmark datasets, define model-evaluation strategies, design reasoning assessments, and develop agent-evaluation frameworks.Research and innovation: stay current on AI advancements, introduce emerging best practices, and support capability development.Technical reviews: assess data methodologies, review evaluation systems, identify methodological weaknesses, and recommend improvements. Requirements 8-12+ years of experience in AI/ML research or applied AI.PhD preferred in Computer Science, Artificial Intelligence, Machine Learning, or Statistics.Expertise in large language models, AI agents, synthetic data, reinforcement learning, evaluation systems, and model benchmarking.Strong written English and the ability to communicate complex ideas clearly.Comfortable working independently in a remote environment.Based in India. A leading AI lab is expanding its roster of expert contributors, and Braintrust is helping identify senior experts for this advisory role. As a Principal AI Research Scientist / Applied AI Consultant, you will serve as the technical authority for highly complex AI projects, providing expertise on model behavior, benchmarking methodologies, synthetic-data strategies, evaluation systems, and emerging AI capabilities. You will work with program leadership and client stakeholders to assess feasibility, review methodologies, and shape how advanced AI systems are evaluated and improved. This is a remote, flexible engagement contributing to frontier AI work. Responsibilities Technical advisory: participate in solution discussions, assess project feasibility, review methodologies, and recommend evaluation approaches.Benchmark design: create benchmark datasets, define model-evaluation strategies, design reasoning assessments, and develop agent-evaluation frameworks.Research and innovation: stay current on AI advancements, introduce emerging best practices, and support capability development.Technical reviews: assess data methodologies, review evaluation systems, identify methodological weaknesses, and recommend improvements. Requirements 8-12+ years of experience in AI/ML research or applied AI.PhD preferred in Computer Science, Artificial Intelligence, Machine Learning, or Statistics.Expertise in large language models, AI agents, synthetic data, reinforcement learning, evaluation systems, and model benchmarking.Strong written English and the ability to communicate complex ideas clearly.Comfortable working independently in a remote environment.Based in India.

One address, no account. We’ll tell you when matching roles go live.

More at Braintrust

Related open roles

View all roles