Open Source Contributor (Remote AI Evaluation Contract)

Welcome to Jobtacular! We connect top-tier domain practitioners directly with frontier AI labs. We are on the hunt for a sharp, detail-oriented Open Source Contributor (Remote AI Evaluation Contract) ($60 - $120/hour) to assist with benchmarking and human evaluation. If you have deep experience in Python3, JAVA, Rust, Basics C++, this flexible engagement gives you the freedom to set your own hours while earning top-market hourly rates.

The Role & What You'll Tackle

Pay:

$60–$120/hour equivalent, paid per accepted task

Location:

Global, fully remote

Job Type:

Contractor

Time Commitment:

15+ hours per week

Schedule:

Flexible

Our platform is seeking exceptional open-source contributors to support an AI-training project focused on complex, real-world technical workflows.

In this role, you will use your programming and domain expertise to create, solve, review, and validate challenging tasks in software engineering, machine learning, science, hardware, or engineering. Your work will help improve how advanced AI systems reason, write code, use technical tools, and complete long-horizon projects.

Prior AI-training experience is not required. We are primarily looking for candidates with strong, publicly verifiable technical work.

What You’ll Work On

1. Create realistic technical tasks based on professional, scientific, or engineering workflows.
2. Build reproducible task environments, reference solutions, tests, and objective evaluation criteria.
3. Review AI-generated work for correctness, completeness, and technical quality.
4. Diagnose model failures and explain why an approach or result is incorrect.

Your Background & Core Strengths

1. Strong programming ability, including practical proficiency with Python.
2. Meaningful contributions to open-source software or substantial original public projects.
3. Experience in at least one relevant area, including:
4. Software engineering
5. Machine learning or data science
6. Scientific computing
7. Hardware, embedded systems, or electronics
8. Mechanical, aerospace, civil, chemical, or electrical engineering
9. Developer tools, infrastructure, automation, or security

Public Proof of Skill

Applicants should be able to provide publicly verifiable evidence such as:

1. Meaningful merged contributions to established repositories
2. Maintainer or core-contributor responsibilities
3. Substantial original repositories or technical tools
4. Scientific or engineering software contributions
5. Public code supporting published research
6. Contributions involving implementation, debugging, testing, performance, infrastructure, simulation, or data processing

Forks, tutorial-only repositories, superficial documentation edits, contribution counts, or AI-generated repositories alone are not sufficient.

Your Background & Core Strengths

1. Experience designing technical tests, benchmarks, evaluation tasks, or reproducible environments.
2. Experience reviewing code or technical contributions from others.
3. Competition results, publications, public technical writing, or other evidence of expertise.
4. Previous experience contributing to complex projects over an extended period.

Application Process

1. Submit your application and public technical profiles.
2. Complete an AI interview that includes technical and integrity checks.
3. Complete a hiring-manager review.
4. If selected, complete project onboarding and begin your first assigned task.

Compensation

Compensation is output-based. Experts are paid for tasks that meet project specifications and quality requirements. The time required for each task will vary based on its complexity and the expert’s workflow.

Rate, Schedule & Why You'll Love It

This contract position is offered at $60 - $120/hour with immediate onboarding upon approval. Work 100% remotely from the United States, UK, Canada, Australia, New Zealand, or Ireland. Candidates are evaluated on verified subject matter mastery. Select Apply Now below to access the official candidate assessment portal directly.