Domain Contributor & AI Evaluation Specialist (Remote AI Evaluation Contract)
Hiring Agency: Jobtacular • Updated Today
Position Description
If you're passionate about testing the boundaries of cutting-edge technology, Jobtacular has your next breakthrough engagement. We're placing an exceptional Domain Contributor & AI Evaluation Specialist (Remote AI Evaluation Contract) earning $30 - $60/hour to work directly on high-impact AI model training. You'll team up with frontier research labs to construct gold-standard benchmarks and stress-test machine reasoning using your deep expertise in Domain depth, Source verification, Reasoning clarity, Evaluation expertise. No commute, high hourly yield, and pure technical impact.
The Mission & Daily Problems You'll Tackle
- Author questions and scenarios demanding deep subject knowledge, beyond general understanding.
- Assess AI-generated outputs, validating accuracy against authoritative, primary sources in your area of expertise.
- Document clear rationales for model shortcomings, specifying missed reasoning, source errors, or nuances.
- Apply detailed task guidelines and evaluation rubrics consistently to each submission.
- Submit completed deliverables independently on a rolling basis, meeting project requirements for written and verbal clarity.
- Design nuanced, domain-specific tasks that probe AI model limits and surface reasoning flaws.
Your Background & Superpowers
- Advanced research skills with a track record of verifying complex claims against authoritative sources.
- Exceptional written and verbal communication skills to articulate findings and feedback.
- Demonstrated ability to precisely follow detailed instructions and evaluation frameworks.
- Background in adversarial or “stomp the model” task design is advantageous.
- Graduate-level research, experience at a Fortune 100 company, or professional fluency in a non-English language a plus.
- Proven hands-on experience with AI model training, annotation, RLHF, or evaluation.
- Deep expertise in a core domain: history, archival or library science, law (paralegal, legal academic, compliance), finance (equity research, PE/VC, forensic accounting), journalism, or technology/industry history.
The Numbers: Pay, Hours & Autonomy
- Compensation Rate: $30 - $60/hour (verified contractor remuneration)
- Work Arrangement: 100% Remote / Work From Home
- Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
- Core Competencies: Domain depth, Source verification, Reasoning clarity, Evaluation expertise
- Hiring Lead: Alex Rivera (Head of AI Sourcing) at Jobtacular
Direct Application Process: Click the Apply button on this page to submit your profile directly for immediate evaluation.