Source description
About the role
Role Overview: You will be part of a project focused on building LLM evaluation and training datasets for realistic software engineering problems. Your main responsibility will be to contribute as an experienced software engineer (tech lead level) by working on high-quality public GitHub repositories. This role involves hands-on software engineering tasks such as development setting automation, issue triaging, and evaluating test coverage and quality. Key Responsibilities: - Analyze and triage GitHub issues across trending open-source libraries. - Set up and configure code repositories, including Dockerization and environment setup. - Evaluate unit test coverage and quality. - Modify and run codebases locally to assess LLM performance in bug-fixing scenarios. - Collaborate with researchers to design and identify challenging repositories and issues for LLMs. - Lead a team of junior engineers to collaborate on projects. Qualifications Required: - Minimum 3+ years of overall experience. - Strong experience in JavaScript / TypeScript. - Proficiency with Git, Docker, and basic software pipeline setup. - Ability to understand and navigate complex codebases. - Comfortable running, modifying, and testing real-world projects locally. - Experience contributing to or evaluating open-source projects is a plus. Additional Details: Confidential company is a rapidly growing AI company focused on advancing and deploying powerful AI systems. By joining us, you will play a key role in evaluating how LLMs interact with real code, influencing the future of AI-assisted software development. This unique opportunity allows you to blend practical software engineering with AI research. Role Overview: You will be part of a project focused on building LLM evaluation and training datasets for realistic software engineering problems. Your main responsibility will be to contribute as an experienced software engineer (tech lead level) by working on high-quality public GitHub repositories. This role involves hands-on software engineering tasks such as development setting automation, issue triaging, and evaluating test coverage and quality. Key Responsibilities: - Analyze and triage GitHub issues across trending open-source libraries. - Set up and configure code repositories, including Dockerization and environment setup. - Evaluate unit test coverage and quality. - Modify and run codebases locally to assess LLM performance in bug-fixing scenarios. - Collaborate with researchers to design and identify challenging repositories and issues for LLMs. - Lead a team of junior engineers to collaborate on projects. Qualifications Required: - Minimum 3+ years of overall experience. - Strong experience in JavaScript / TypeScript. - Proficiency with Git, Docker, and basic software pipeline setup. - Ability to understand and navigate complex codebases. - Comfortable running, modifying, and testing real-world projects locally. - Experience contributing to or evaluating open-source projects is a plus. Additional Details: Confidential company is a rapidly growing AI company focused on advancing and deploying powerful AI systems. By joining us, you will play a key role in evaluating how LLMs interact with real code, influencing the future of AI-assisted software development. This unique opportunity allows you to blend practical software engineering with AI research.
More at Recognized
Related open roles
1089Senior Statistical Programmer Consultant (India)
India
Senior Professional Product Developer - Hiring Now (Chennai)
Chennai
React Js Developer - PET (Chennai)
Chennai
Java Full-Stack Engineer (Hyderabad)
Hyderabad
AES Salesforce CRMA- Senior Associate- Consult (Pune)
Mumbai
AS -QT -DevOps (Hyderabad)
Hyderabad