Description
Confidential company is hiring a remote Model Evaluator – AI/ML (contract, entry level). The role is open to people living in any country. The employer has not published a salary. Working hours: Remote, 8 hour per day. You apply directly on the employer's site.
About the role
We are seeking Software Engineers to support a frontier AI training and evaluation initiative focused on improving the coding capabilities of AI agents. In this role, you will review and compare AI-generated coding solutions across real-world software engineering tasks. You will analyze complete agent execution workflows, evaluate code correctness, efficiency, safety, and overall quality, and provide structured ratings and evidence-based feedback to help improve AI-assisted software development.
What you'll do
- You'll review three AI coding agents that were each given the same real developer request.
- You read each agent's full run: the commands it ran, the files it changed, what it checked and its final message.
- Then you judge which run did the job best.
Requirements
- Strong experience with at least one of the following languages: Python, JavaScript/TypeScript, Java, Go, PHP or similar.
Pay per task
$25 per approved task
Skills
- Machine Learning
Who can apply
This job is open to people living in any country. There are no location restrictions. Working hours: Remote, 8 hour per day.
How to apply
- 1Check that you live where this job hires (any country) and can work remote, 8 hour per day.
- 2Click “Apply Now” to open Confidential company's application page.
- 3Apply soon: listings close when the role is filled.
Interested in this role?
Apply directly to Confidential company. It's free, and HRjobs never charges candidates.
