Source description
About the role
Engagement Details : - Remote (India) - 4-Month Contract - Full-Time (40 Hours/Week , 8hrs/day) - 90,000 1,00,000 per month About the Role Biz-Tech Analytics is hiring experienced software engineers to evaluate and validate real-world software engineering tasks used to benchmark advanced AI coding systems. This is a hands-on technical role for engineers who enjoy debugging, testing, reviewing code, and investigating complex software behavior. You will work with large open-source repositories, Dockerized environments, Linux systems, and language-specific testing frameworks to ensure benchmark tasks are accurate, reproducible, and production-ready. What You'll Do Review benchmark tasks, repositories, Dockerfiles, test suites, and solution patches Execute and validate tasks in isolated Docker environments Identify flaky tests, hidden dependencies, and non-deterministic behavior Verify solution correctness and benchmark reproducibility Analyze execution logs, failures, and edge cases Detect loopholes that may allow AI systems to bypass intended solutions Provide clear, structured, and actionable technical feedback Required Skills 3+ years of production software development experience Solid expertise in one or more of: Python, Java, C/C++, Linux, Shell/Bash, Docker, SQL, DevOps, Systems Engineering Hands-on experience with Docker and Linux CLI Strong debugging and troubleshooting skills Familiarity with testing frameworks and build systems Ability to understand unfamiliar codebases quickly Excellent written communication skills Preferred Qualifications Open-source contribution experience Kubernetes, Terraform, or Infrastructure-as-Code CI/CD pipelines and automation Security, observability, or platform engineering experience Ideal Candidate You enjoy finding what's broken, understanding why it broke, and ensuring software behaves correctly under real-world conditions. You are comfortable working in termi .
More at Biz-Tech Analytics