Source description
About the role
As a PhD level computer science expert, your role will involve fine-tuning and evaluating large language models, particularly systems similar to ChatGPT. You will be responsible for designing challenging computer science problems that test advanced AI reasoning in various domains such as algorithms, systems design, cybersecurity, theory, databases, and networks. Your key responsibilities will include: - Designing advanced computer science problems to assess AI model performance in conceptual and reasoning-heavy areas - Developing clear reference solutions with rigorous logic and well-structured explanations - Evaluating AI-generated responses for correctness, reasoning quality, completeness, clarity, and alignment with problem requirements - Identifying flaws, gaps, edge cases, and reasoning patterns in AI outputs - Collaborating with researchers to refine benchmarks across different computer science topics - Providing structured feedback to enhance problem quality, benchmark reliability, and model evaluation standards To qualify for this role, you should have: - A PhD in Computer Science or a closely related field - Strong computer science reasoning and problem-solving skills in advanced domains - The ability to design challenging conceptual problems that require deep understanding - Excellent written communication skills to explain complex technical ideas clearly - Strong attention to detail in evaluating reasoning, assumptions, definitions, edge cases, and solution validity - The capability to provide high-quality feedback on AI-generated responses - No prior AI experience is required The evaluation process for this position includes: - Submission of a Job Interest Form for approved candidates - Completion of an assessment within 24 hours after profile review - Shortlisted candidates will be contacted for an interview based on assessment outcomes As a PhD level computer science expert, your role will involve fine-tuning and evaluating large language models, particularly systems similar to ChatGPT. You will be responsible for designing challenging computer science problems that test advanced AI reasoning in various domains such as algorithms, systems design, cybersecurity, theory, databases, and networks. Your key responsibilities will include: - Designing advanced computer science problems to assess AI model performance in conceptual and reasoning-heavy areas - Developing clear reference solutions with rigorous logic and well-structured explanations - Evaluating AI-generated responses for correctness, reasoning quality, completeness, clarity, and alignment with problem requirements - Identifying flaws, gaps, edge cases, and reasoning patterns in AI outputs - Collaborating with researchers to refine benchmarks across different computer science topics - Providing structured feedback to enhance problem quality, benchmark reliability, and model evaluation standards To qualify for this role, you should have: - A PhD in Computer Science or a closely related field - Strong computer science reasoning and problem-solving skills in advanced domains - The ability to design challenging conceptual problems that require deep understanding - Excellent written communication skills to explain complex technical ideas clearly - Strong attention to detail in evaluating reasoning, assumptions, definitions, edge cases, and solution validity - The capability to provide high-quality feedback on AI-generated responses - No prior AI experience is required The evaluation process for this position includes: - Submission of a Job Interest Form for approved candidates - Completion of an assessment within 24 hours after profile review - Shortlisted candidates will be contacted for an interview based on assessment outcomes
More at Codefeast