Member of Technical Staff, Coding Research — AI Infrastructure & Operations (Remote AI Evaluation Contract)

Join Jobtacular as a remote Member of Technical Staff, Coding Research — AI Infrastructure & Operations (Remote AI Evaluation Contract) ($600,000 - $1,300,000/year). We partner with leading AI research laboratories across major English-speaking markets to evaluate complex responses, design realistic domain scenarios, and calibrate next-generation foundation models using deep professional expertise in LLMs, Coding Evaluation, AI Evaluation, ML Systems.

What You Will Do

• Lead from initial concept through completion research initiatives focused on measuring and improving coding model performance across diverse software engineering tasks.
• Develop high-quality datasets, golden examples, and evaluation protocols that enable reliable assessment of frontier coding systems.
• Analyze model behavior and failure modes, identifying systematic weaknesses and translating findings into actionable improvements for training and evaluation.
• Build tooling and infrastructure that support large-scale experimentation, data generation, review workflows, and evaluation pipelines.
• Establish best practices for coding-agent assessment, ensuring methodological rigor, reproducibility, and measurement quality.
• Partner closely with researchers, engineers, and applied AI teams to design experiments and evaluate emerging model capabilities.
• Contribute to technical reports, benchmark studies, and client-facing research initiatives that communicate model performance and insights.

Who We Are Looking For

• Experience working on frontier AI systems, coding agents, or model evaluation research.
• Deep interest in understanding how data, evaluations, and feedback mechanisms influence model capabilities.
• Track record of independently driving ambiguous technical or research projects from conception to execution.
• Experience designing benchmarks or datasets for machine learning systems at scale.
• Working knowledge of agentic workflows, tool use, reinforcement learning, or post-training methodologies.
• Publications, open-source contributions, or demonstrated technical leadership in AI, machine learning, or software engineering.
• Compensation & Benefits Notice

Compensation & Remote Structure

• Compensation Rate: $600,000 - $1,300,000/year (contract specialist remuneration)
• Work Arrangement: 100% Remote / Work From Home
• Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
• Core Competencies: LLMs, Coding Evaluation, AI Evaluation, ML Systems
• Hiring Agency: Jobtacular

Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.