Academic Research & AI Evaluation Specialist (PhD/MSc/Professor) (Remote AI Evaluation Contract)
If you're passionate about testing the boundaries of cutting-edge technology, Jobtacular has your next breakthrough engagement. We're placing an exceptional Academic Research & AI Evaluation Specialist (PhD/MSc/Professor) (Remote AI Evaluation Contract) earning $30 - $60/hour to work directly on high-impact AI model training. You'll team up with frontier research labs to construct gold-standard benchmarks and stress-test machine reasoning using your deep expertise in Research & source triangulation, Attention to detail, Written precision, Self-direction & reliability. No commute, high hourly yield, and pure technical impact.
The Mission & Daily Problems You'll Tackle
- Source, verify, and thoroughly document answers using primary sources and authoritative references, including clear citations and reasoning.
- Design questions demanding advanced reasoning, methodological nuance, or synthesis across multiple sources, ensuring resistance to oversimplified or shortcut solutions.
- Test questions against AI systems, identify items that are not sufficiently challenging, and iteratively increase complexity while maintaining accuracy.
- Write each question and answer with high precision and clarity, eliminating ambiguity and supporting defensible responses.
- Integrate reviewer feedback and consistently uphold all project guidelines and quality standards throughout your deliverables.
- Create original, high-difficulty question-and-answer pairs at the cutting edge of your discipline to rigorously assess AI model capabilities.
Your Background & Superpowers
- Exceptional analytical thinking, close attention to detail, and strong written communication skills in English.
- Experience sourcing and triangulating information from authoritative references.
- Proven self-direction and reliability in delivering expert-level work independently within remote engagements.
- Skill in composing challenging, original, and methodologically sound questions.
- Prior experience in AI training, data labeling, or model evaluation is required.
- Masters or PhD completed, active candidacy, or equivalent research experience as a specialist, researcher, assistant professor or professor in your domain.
- Demonstrated track record of scholarly research, in-depth subject matter expertise, and familiarity with primary literature.
The Numbers: Pay, Hours & Autonomy
- Compensation Rate: $30 - $60/hour (verified contractor remuneration)
- Work Arrangement: 100% Remote / Work From Home
- Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
- Core Competencies: Research & source triangulation, Attention to detail, Written precision, Self-direction & reliability, Analytical thinking, Research mastery
- Hiring Lead: Alex Rivera (Head of AI Sourcing) at Jobtacular
Direct Application Process: Click the Apply button on this page to submit your profile directly for immediate evaluation.