AI Safety Evaluation Specialist

Role: AI Safety Evaluation Specialist

We are hiring on behalf of one of our clients for experienced safety specialists to evaluate and strengthen advanced AI systems. This role focuses on identifying vulnerabilities, assessing systemic risks, and contributing to the development of more robust and reliable AI models. This is a project-based, remote contract opportunity suited for professionals with experience in AI safety, model evaluation, security testing, or related analytical fields.

Key Responsibilities

• Identify and document model limitations, vulnerabilities, and failure patterns
• Annotate outputs and classify risks using structured taxonomies and evaluation frameworks
• Develop reproducible testing cases and structured reports
• Conduct adversarial testing across language models and socio-technical risk scenarios
• Evaluate AI outputs against defined safety benchmarks and guidelines
• Produce clear, actionable documentation for technical and non-technical stakeholders
• Collaborate with project teams to improve model robustness and evaluation methodologies

Required Qualifications

• Experience in AI safety, security research, red teaming, model evaluation, or related technical domains
• Strong analytical and structured problem-solving skills
• Ability to document findings clearly and reproducibly
• Familiarity with risk assessment frameworks or benchmarking methodologies
• Strong written communication skills

Preferred Qualifications

• Experience with adversarial testing or model vulnerability research
• Background in cybersecurity, machine learning, or socio-technical risk analysis
• Experience working with evaluation datasets or safety benchmarking tools
• Ability to translate complex technical findings into clear, structured reports

Engagement Details

• Independent contractor engagement
• Fully remote with flexible scheduling
• Project-based work; extensions may occur based on project needs and performance
• Hourly compensation range: $85–$185 depending on expertise and scope
• Weekly payments via secure payment platforms

Applicants must be legally authorized to provide independent contractor services in their country of residence.

Key skills/competency

• AI Safety
• Model Evaluation
• Risk Assessment
• Vulnerability Identification
• Adversarial Testing
• Security Research
• Structured Problem-solving
• Documentation
• Communication Skills
• Evaluation Frameworks