App Security Expert (Remote AI Evaluation Contract)
Hiring Agency: Jobtacular • Updated Today
Position Description
Join Jobtacular as a remote App Security Expert (Remote AI Evaluation Contract) ($40 - $80/hour). We partner with leading AI research laboratories across major English-speaking markets to evaluate complex responses, design realistic domain scenarios, and calibrate next-generation foundation models using deep professional expertise in OSWE, LLM security, AI-SAST evaluation, AppSec.
What You Will Do
- Develop deterministic test cases and security-context manifests to robustly assess application security posture.
- Create detailed hidden answer keys to enable accurate AI or scanner evaluation of vulnerable versus secure code.
- Evaluate and iterate on pipeline methodologies to ensure synthetic tasks and fixtures are challenging yet realistic for AppSec assessment.
- Document technical insights and methodologies, ensuring clarity in written feedback and communication.
- Collaborate through clear and thorough written and verbal communication to share findings and review peer contributions.
- Engage with agent-based security architecture and contribute to continuous improvement of the evaluation pipeline.
- Demonstrated professional or academic background in OSWE, LLM security, AI-SAST evaluation, AppSec, Agent security architecture.
Who We Are Looking For
- Demonstrated history designing or evaluating security architecture for traditional and agent-based applications.
- Expertise in building, securing, and testing application codebases, including identifying and remediating advanced vulnerabilities.
- Exceptional written and verbal communication skills, with a focus on precise technical documentation and collaborative feedback.
- Practical background using synthetic security fixtures and deterministic testing approaches is highly desirable.
- Demonstrated ability to deliver thoughtful insights and actionable security recommendations in a remote contribution context.
- Compensation Band: $40 - $80/hour
- Work Location: Remote (100% Remote / Asynchronous Flexibility)
Compensation & Remote Structure
- Compensation Rate: $40 - $80/hour (contract specialist remuneration)
- Work Arrangement: 100% Remote / Work From Home
- Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
- Core Competencies: OSWE, LLM security, AI-SAST evaluation, AppSec, Agent security architecture
- Hiring Agency: Jobtacular
Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.