Human Intelligence Collector — AI Model Training & Evaluation (Remote AI Evaluation Contract)
Hiring Agency: Jobtacular • Updated Today
Position Description
Join Jobtacular as a remote Human Intelligence Collector — AI Model Training & Evaluation (Remote AI Evaluation Contract) ($25 - $65/hour). We partner with leading AI research laboratories across major English-speaking markets to evaluate complex responses, design realistic domain scenarios, and calibrate next-generation foundation models using deep professional expertise in Elicitation strategy, Real-time cue reading, Reliability assessment, Interrogation/investigative questioning.
What You Will Do
- Establish rapport with participants to encourage open communication without applying pressure or coercion
- Analyze responses in real-time, reading tone, pacing, and nonverbal cues, and dynamically adjusting questioning strategies
- Assess the internal consistency, reliability, and potential evasiveness of responses, providing confidence assessments for each interaction
- Identify and annotate emotional and motivational drivers influencing participants' responses
- Document your analytical reasoning in a clear, traceable manner to support downstream review and learning
- Score or annotate sessions according to a detailed rubric, maintaining objectivity and consistency across multiple cases
- Demonstrated professional or academic background in Elicitation strategy, Real-time cue reading, Reliability assessment, Interrogation/investigative questioning, Attention to detail.
Who We Are Looking For
- Expertise in real-time interpretation of paralinguistic and nonverbal cues (tone, pacing, hesitation, gestures)
- Demonstrated ability to clearly justify analytical reads in writing, not just by intuition
- Exceptional written English skills with a focus on clarity, precision, and defensibility
- Experience working with diverse populations or through interpreters
- Working knowledge of data annotation, AI model evaluation, or after-action/assessment report writing
- Compensation Band: $25 - $65/hour
- Work Location: Remote (100% Remote / Asynchronous Flexibility)
Compensation & Remote Structure
- Compensation Rate: $25 - $65/hour (contract specialist remuneration)
- Work Arrangement: 100% Remote / Work From Home
- Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
- Core Competencies: Elicitation strategy, Real-time cue reading, Reliability assessment, Interrogation/investigative questioning, Attention to detail
- Hiring Agency: Jobtacular
Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.