AI Agent Evaluator (Remote AI Evaluation Contract)
Hiring Agency: Jobtacular • Updated Today
Position Description
Join Jobtacular as a remote AI Agent Evaluator (Remote AI Evaluation Contract) ($25 - $45/hour). We partner with leading AI research laboratories across major English-speaking markets to evaluate complex responses, design realistic domain scenarios, and calibrate next-generation foundation models using deep professional expertise in ChatGPT, Muse, AI agents, Attention to Detail.
What You Will Do
- Approve or stop the agent at key steps
- Screen record every attempt
- Score each run on completion, quality, control issues, satisfaction, and time
- Share clear written feedback on the agent experience
- Who we’re looking for
- US-based, with a Bachelor’s degree
- Someone who already uses AI in daily life
Who We Are Looking For
- How the selection process works
- Complete the screening questions
- Interview: 15-30 minutes max
- Profile review: if everything looks good, we present you to the client
- Onboarding: our Talent Ops team will contact you to get you started
- Demonstrated professional or academic background in ChatGPT, Muse, AI agents, Attention to Detail, Following Instructions, Screen Recording.
- Strong analytical reasoning and ability to articulate complex concepts clearly in written English.
Compensation & Remote Structure
- Compensation Rate: $25 - $45/hour (contract specialist remuneration)
- Work Arrangement: 100% Remote / Work From Home
- Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
- Core Competencies: ChatGPT, Muse, AI agents, Attention to Detail, Following Instructions, Screen Recording
- Hiring Agency: Jobtacular
Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.