211 Specialist — AI Model Training & Evaluation (Remote AI Evaluation Contract)
Hiring Agency: Jobtacular • Updated Today
Position Description
Join Jobtacular as a remote 211 Specialist — AI Model Training & Evaluation (Remote AI Evaluation Contract) ($30 - $40/hour). We partner with leading AI research laboratories across major English-speaking markets to evaluate complex responses, design realistic domain scenarios, and calibrate next-generation foundation models using deep professional expertise in analytical reasoning and domain evaluation.
What You Will Do
- Write rubrics that define a correct, complete answer, including the right referrals and next steps for the caller.
- Assess and benchmark model-generated answers against your rubrics, flagging errors, omissions, outdated guidance, and answers that wouldn’t help a real caller.
- Share clear written feedback with the project team, working asynchronously.
- Experience as a 211 Specialist, Information & Referral Specialist, or Benefits Navigator, answering public questions about government services
- 1+ years of regular, high-volume public contact (phone, chat, or in person)
- Working knowledge of public benefits and community resources
- Able to start quickly and commit 10-20 hours/week
Who We Are Looking For
- Experience using community resource databases
- Experience creating guides, scripts, or training materials
- Experience helping a diverse range of callers, including rural and Spanish-speaking communities
- Compensation Band: $30 - $40/hour
- Work Location: Remote (100% Remote / Asynchronous Flexibility)
- Available Openings: 10 open positions
- Clear, precise writing
Compensation & Remote Structure
- Compensation Rate: $30 - $40/hour (contract specialist remuneration)
- Work Arrangement: 100% Remote / Work From Home
- Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
- Core Competencies: 211 Specialist — AI Model Training & Evaluation
- Hiring Agency: Jobtacular
Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.