Python & CI/CD DevOps Software Developer — AI Infrastructure (Remote AI Evaluation Contract)

Join Jobtacular as a remote Python & CI/CD DevOps Software Developer — AI Infrastructure (Remote AI Evaluation Contract) ($50 - $70/hour). We partner with leading AI research laboratories across major English-speaking markets to evaluate complex responses, design realistic domain scenarios, and calibrate next-generation foundation models using deep professional expertise in CI/CD, Scripting, Python, REST API.

What You Will Do

• Assess and grade the technical correctness of outputs, verifying results hands-on within relevant development environments and tools.
• Design, seed, and maintain reproducible test environments—such as code repositories with real commit histories and CI workflows—to ensure reliable and realistic task contexts.
• Configure, document, and troubleshoot integrations and authentication flows across multiple software services, ensuring seamless connectivity.
• Investigate and document undocumented product behaviors through hands-on exploration and systematic testing.
• Participate in calibration sessions to ensure consistent evaluation methods and grading across the contributor group.
• Demonstrated professional or academic background in CI/CD, Scripting, Python, REST API, QA.
• Strong analytical reasoning and ability to articulate complex concepts clearly in written English.

Who We Are Looking For

• Advanced scripting abilities in Python or Bash, with comfort in automating environment setup and reset tasks; solid understanding of REST APIs, OAuth, and webhook integrations.
• Fluency with major enterprise SaaS platforms such as Slack, Google Workspace, or Microsoft 365; administrative experience in cloud workspaces is advantageous.
• Experience leveraging AI assistants or agent tools in everyday developer tasks; any familiarity with agent tool-calling or the Model Context Protocol (MCP) is a plus.
• Background in technical QA, evaluation, or data annotation—demonstrating consistency in applying rubrics and identifying nuanced edge cases.
• Exceptional attention to detail, disciplined adherence to defined processes, and outstanding written and verbal communication in English.
• Compensation Band: $50 - $70/hour
• Work Location: Remote (100% Remote / Asynchronous Flexibility)

Compensation & Remote Structure

• Compensation Rate: $50 - $70/hour (contract specialist remuneration)
• Work Arrangement: 100% Remote / Work From Home
• Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
• Core Competencies: CI/CD, Scripting, Python, REST API, QA
• Hiring Agency: Jobtacular

Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.