Software Engineer - Backend (Remote AI Evaluation Contract)

Welcome to Jobtacular! We connect top-tier domain practitioners directly with frontier AI labs. We are on the hunt for a sharp, detail-oriented Software Engineer - Backend (Remote AI Evaluation Contract) ($50 - $100/hour) to assist with benchmarking and human evaluation. If you have deep experience in Python3, JAVA, Rust, Algorithms, this flexible engagement gives you the freedom to set your own hours while earning top-market hourly rates.

The Role & What You'll Tackle

Opportunity Snapshot

Pay:

$50–100

Time per task:

5 hours for trainers and 1.5 hours for reviewers

Engagement:

Project-based — paid per approved task

Commitment:

~15 hours per week

Location:

Fully remote

You’ll need:

Hands-on expertise in at least one of Python, Java, Rust, Go, C++, or TypeScript

Your tasks:

Build challenging coding problems from real repositories, with reproducible environments and verifiers

Role Title:

Software Engineer - Backend

Role Type

: Contractor (~15 hrs a week)

Location:

Remote

You’ll create Reinforcement Learning Environments that test a model’s ability to solve real software engineering problems: tracking down subtle bugs, building non-trivial features, refactoring, and optimizing performance. Each task means defining the problem, building a reproducible environment, and writing a reference solution.

The Role & What You'll Tackle

1. Create realistic, challenging coding tasks for frontier AI models, drawn from repositories you know well.
2. Design problems that require real engineering skill — subtle bugs, non-trivial features, meaningful performance work — not lookup or boilerplate.
3. Build a reproducible environment for each task.
4. Write deterministic verifiers that accept correct solutions across different valid implementations, while rejecting incorrect, incomplete, or hard-coded approaches.
5. Provide a reference solution showing how the task can be solved.
6. Flag tasks that turn out to be ambiguous or unverifiable rather than submitting them.

Your Background & Core Strengths

1. Significant hands-on expertise in at least one of: Python3, Java, Rust, Go, C++, or TypeScript.
2. Deep understanding of algorithms, data structures, and software engineering principles.
3. Proven ability to debug complex systems, resolve bugs, and deliver effective optimizations.
4. Experience with large codebase refactoring and legacy system modernization.
5. Track record of delivering high-impact features from conception through delivery.
6. Strong documentation and communication skills to articulate technical concepts clearly.
7. Interest in AI and its technical challenges — previous AI experience not required.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required may vary depending on your experience and workflow.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

How the selection process works

1. Apply and complete the screening questions
2. Complete the AI interview for this role — it’s how your expertise gets in front of the client
3. Profile review
4. Onboarding — our Talent Ops team will get you set up

Rate, Schedule & Why You'll Love It

This contract position is offered at $50 - $100/hour with immediate onboarding upon approval. Work 100% remotely from the United States, UK, Canada, Australia, New Zealand, or Ireland. Candidates are evaluated on verified subject matter mastery. Select Apply Now below to access the official candidate assessment portal directly.