Member of Technical Staff, Frontier AI (Full-Time Remote) (Remote AI Evaluation Contract)

Join Jobtacular as a remote Member of Technical Staff, Frontier AI (Full-Time Remote) (Remote AI Evaluation Contract) ($600,000 - $2,000,000/year). We partner with leading AI research laboratories across major English-speaking markets to evaluate complex responses, design realistic domain scenarios, and calibrate next-generation foundation models using deep professional expertise in Research Signal Judgment, ML-Oriented Data Design, Ops-to-Research Translation, RL Environments.

What You Will Do

• Design ML-oriented data systems, including task definitions, annotation schemas, rubrics, incentives, and pipelines optimized for downstream model performance.
• Analyze model and system failures to identify root causes, edge cases, and opportunities for improvement.
• Translate ambiguous, real-world behavior into structured evaluation frameworks and new data categories.
• Partner cross-functionally with researchers and domain experts to calibrate quality early and continuously raise the signal bar.
• Iterate rapidly on evaluations, datasets, and feedback loops to improve system performance.
• Act as a quality gate: block claims, pause work, or force scope changes when signal strength or data integrity is insufficient.
• Partner with cross-functional and client-facing teams to translate research progress into clear, credible narratives grounded in evidence.

Who We Are Looking For

• A systems-level mindset, with interest in improving from initial concept through completion model or agent performance rather than isolated components.
• Practical background using reinforcement learning environments, simulators, or feedback-driven training systems.
• Experience improving agentic systems or AI systems operating in real-world workflows.
• Prior work embedded in applied research or production environments with direct impact on deployed systems.
• Practical background using evaluation design for complex or real-world tasks.
• Working knowledge of expert incentive design and engagement in high-stakes technical projects.
• Compensation & Benefits Notice

Compensation & Remote Structure

• Compensation Rate: $600,000 - $2,000,000/year (contract specialist remuneration)
• Work Arrangement: 100% Remote / Work From Home
• Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
• Core Competencies: Research Signal Judgment, ML-Oriented Data Design, Ops-to-Research Translation, RL Environments
• Hiring Agency: Jobtacular

Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.