Data Analyst (AI Evaluation) — AI Data Quality & Analytics (Remote AI Evaluation Contract)
Hiring Agency: Jobtacular • Updated Today
Position Description
Join Jobtacular as a remote Data Analyst (AI Evaluation) — AI Data Quality & Analytics (Remote AI Evaluation Contract) ($30 - $60/hour). We partner with leading AI research laboratories across major English-speaking markets to evaluate complex responses, design realistic domain scenarios, and calibrate next-generation foundation models using deep professional expertise in Data Analysis, Data Review, Attention to detail, Handling ambiguity.
What You Will Do
- Identify and flag inconsistencies, errors, and outputs that deviate from provided instructions.
- Apply structured rubrics and evaluation criteria consistently across large data sets.
- Exercise sound judgment and document rationale in ambiguous scenarios where guidelines are unclear.
- Escalate patterns or recurring data issues for further analysis rather than addressing them individually.
- Supply detailed, transparent, actionable written and verbal feedback pinpointing issues and suggesting resolution paths.
- Maintain meticulous attention to detail while working through high volumes of repetitive data review assignments.
- Demonstrated professional or academic background in Data Analysis, Data Review, Attention to detail, Handling ambiguity, Error spotting.
Who We Are Looking For
- Exceptional ability to follow detailed written instructions and apply complex evaluation rubrics precisely.
- Demonstrated comfort with ambiguity, including making justifiable decisions when guidelines are incomplete.
- Advanced attention to detail and error-spotting capabilities across repetitive or high-volume work.
- Strong written and verbal communication skills for documenting findings and providing feedback.
- Baseline fluency with spreadsheets (sorting, filtering, simple formulas); SQL or hands-on data querying is a plus.
- Practical background using data annotation, labeling, or rubric-based evaluation is advantageous.
- Compensation Band: $30 - $60/hour
Compensation & Remote Structure
- Compensation Rate: $30 - $60/hour (contract specialist remuneration)
- Work Arrangement: 100% Remote / Work From Home
- Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
- Core Competencies: Data Analysis, Data Review, Attention to detail, Handling ambiguity, Error spotting
- Hiring Agency: Jobtacular
Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.