AI Trainer (SWE) (Remote AI Evaluation Contract)

Welcome to Jobtacular! We connect top-tier domain practitioners directly with frontier AI labs. We are on the hunt for a sharp, detail-oriented AI Trainer (SWE) (Remote AI Evaluation Contract) ($60 - $120/hour) to assist with benchmarking and human evaluation. If you have deep experience in Software Engineering, AI training, this flexible engagement gives you the freedom to set your own hours while earning top-market hourly rates.

The Role & What You'll Tackle

Pay:

$60–$120/hour equivalent, paid per accepted task

Location:

Global, fully remote

Job Type:

Contractor

Time Commitment:

15+ hours per week

Schedule:

Flexible

Our platform is seeking Software Engineers with prior professional AI-training or model-evaluation experience to support a project focused on improving advanced AI systems.

You will use your software engineering expertise to create challenging technical tasks, evaluate model-generated code, identify failures, and establish objective standards for correct solutions. This role is intended for candidates who have already completed substantive AI-training work.

What You’ll Work On

1. Create realistic software engineering tasks that challenge advanced AI models.
2. Develop task instructions, reproducible environments, reference solutions, tests, and evaluation criteria.
3. Evaluate model-generated code and technical deliverables for correctness, robustness, and completeness.
4. Identify issues involving implementation, debugging, dependencies, performance, testing, or reproducibility.

Your Background & Core Strengths

1. Prior paid experience training, evaluating, benchmarking, or improving AI systems.
2. Strong practical proficiency with Python.
3. Professional experience with at least one additional programming language, such as Java, JavaScript, TypeScript, Rust, C++, C#, or Go.
4. Strong knowledge of software design, debugging, testing, version control, and dependency management.

Public Proof of Skill

Strong applicants should provide evidence such as:

1. Substantial GitHub or GitLab repositories
2. Meaningful open-source contributions
3. Maintainer or core-contributor responsibilities
4. Codeforces, ICPC, Olympiad, or other programming-competition results
5. Public developer tools, libraries, systems, or technical projects
6. Technical publications, benchmarks, or engineering write-ups

Your Background & Core Strengths

1. Experience creating AI-training tasks, reference solutions, tests, graders, or benchmark problems.
2. Experience reviewing other AI trainers’ technical submissions.
3. Codeforces rating of approximately 1900 or higher, or strong results in another programming competition.
4. Experience with Linux, Docker, CI/CD, command-line tools, or sandboxed environments.
5. Prior experience with long-horizon or agentic coding evaluations.
6. Availability to begin immediately.

Application Process

1. Submit your application, AI-training experience, and public technical evidence.
2. Complete an AI interview containing technical and integrity checks.
3. Complete a hiring-manager review.
4. If selected, complete project onboarding and begin your first assigned task.

Compensation

1. Compensation is output-based. Experts are paid for tasks that meet project specifications and quality requirements. Task availability and completion time may vary.

Rate, Schedule & Why You'll Love It

This contract position is offered at $60 - $120/hour with immediate onboarding upon approval. Work 100% remotely from the United States, UK, Canada, Australia, New Zealand, or Ireland. Candidates are evaluated on verified subject matter mastery. Select Apply Now below to access the official candidate assessment portal directly.