QA Engineer (Remote AI Evaluation Contract)

Join Jobtacular as a remote QA Engineer (Remote AI Evaluation Contract) ($63 - $120/hour). We partner with leading AI research laboratories across major English-speaking markets to evaluate complex responses, design realistic domain scenarios, and calibrate next-generation foundation models using deep professional expertise in software quality assurance, test case design, test execution, defect reporting.

What You Will Do

• Review, annotate, and label data sets to enhance machine learning model training accuracy.
• Evaluate, analyze, and report on model predictions, identifying inconsistencies, errors, or patterns for continuous improvement.
• Collaborate with cross-functional teams to communicate findings, raise questions, and clarify project requirements.
• Contribute to the development and refinement of testing methodologies specific to AI-driven systems.
• Maintain detailed, organized records of evaluations, test results, and feedback through written documentation.
• Provide actionable recommendations to optimize data quality and model performance.
• Demonstrated professional or academic background in software quality assurance, test case design, test execution, defect reporting, data annotation, data labeling.

Who We Are Looking For

• Hands-on expertise in software quality assurance, with a strong understanding of test planning and defect reporting.
• Prior experience with data labeling, annotation, reinforcement learning from human feedback (RLHF), or model evaluation.
• Proficiency in English at B2 level or above for effective collaboration and reporting.
• Compensation Band: $63 - $120/hour
• Work Location: Remote (100% Remote / Asynchronous Flexibility)
• Available Openings: 120 open positions
• Core Competencies: software quality assurance, test case design, test execution, defect reporting, data annotation, data labeling, ai model evaluation, documentation, english communication, cross-functional collaboration

Compensation & Remote Structure

• Compensation Rate: $63 - $120/hour (contract specialist remuneration)
• Work Arrangement: 100% Remote / Work From Home
• Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
• Core Competencies: software quality assurance, test case design, test execution, defect reporting, data annotation, data labeling, ai model evaluation, documentation, english communication, cross-functional collaboration
• Hiring Agency: Jobtacular

Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.