Senior Frontier Model Training (Remote AI Evaluation Contract)

Join Jobtacular as a remote Senior Frontier Model Training (Remote AI Evaluation Contract) ($14 - $36/hour). We partner with leading AI research laboratories across major English-speaking markets to evaluate complex responses, design realistic domain scenarios, and calibrate next-generation foundation models using deep professional expertise in Video Annotation, Attention to Detail, Data Labeling, Video Annotation Tools.

What You Will Do

• Apply detailed grading guidelines to accurately evaluate, rank, and annotate model responses, providing structured feedback that improves model performance.
• Write, refine, and stress-test prompts that probe model capabilities, ensuring coverage of diverse scenarios, edge cases, and user intents.
• Verify consistency and accuracy across evaluations, correcting discrepancies between ratings and the underlying rubric or guidelines.
• Utilize AI training tools and platforms to record findings and submit evaluation datasets in alignment with project standards and milestones.
• Collaborate with project trainers and contributors to resolve ambiguities, refine guidelines, and ensure evaluation consistency across the team.
• Participate in ongoing quality reviews, incorporating feedback to maintain rigorous training and annotation standards.
• Exceptional attention to detail and accuracy in reviewing and evaluating model-generated content.

Who We Are Looking For

• Proven experience with AI model training, RLHF, data labeling, or similar data-centric evaluation projects.
• Working knowledge of AI products and tools, including prompt engineering and understanding of model behaviors and limitations.
• Experience writing evaluation rubrics, grading model outputs, or reviewing AI responses for accuracy, helpfulness, and safety.
• Background in AI training, machine learning data preparation, or LLM-focused projects (strongly preferred).
• Compensation Band: $14 - $36/hour
• Work Location: Remote (100% Remote / Asynchronous Flexibility)
• Available Openings: 50 open positions

Compensation & Remote Structure

• Compensation Rate: $14 - $36/hour (contract specialist remuneration)
• Work Arrangement: 100% Remote / Work From Home
• Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
• Core Competencies: Video Annotation, Attention to Detail, Data Labeling, Video Annotation Tools, Time Management
• Hiring Agency: Jobtacular

Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.