AI Evaluation Specialist - Programme
@ International Programme on AI Evaluation: Capabilities and Safety

Hybrid
$0
Hybrid
Full Time
Posted 14 hours ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXXXX XXXXXXXXXXXXX XXXXXXXXX******* @ai-evaluation.org
Recommended after applying

Job Details

About the AI Evaluation Specialist - Programme

International Programme on AI Evaluation: Capabilities & Safety tests, measures, and makes AI accountable. This fully-funded academic programme (150 hours, hybrid) starts in February 2026 with a capstone week in Valencia, Spain in May 2026. The priority application deadline is November 17, 2025.

The Mission

The world doesn’t yet fully understand AI. This programme trains the next generation of AI evaluation and safety specialists. Participants will be equipped to test, measure, and shape how the world trusts and governs AI, transforming scattered insights into a unified discipline.

What You’ll Do

  • Join 40 selected participants from around the world.
  • Participate in 110 online hours and 40 hours of an immersive capstone project in Valencia.
  • Learn from experts at Cambridge, Stanford, Microsoft Research Asia, OpenAI, DeepMind, and more.
  • Gain foundational skills for roles in AI Safety Institutes, government evaluation teams, research labs, and AI companies.

What You’ll Learn

  • Large Language Models & Architectures
  • Metrics, Benchmarks & Experimental Design
  • Red-Teaming & Adversarial Testing
  • Construct-based & Mechanistic Evaluation
  • Governance, Policy & AI Regulation

Ideal Candidates

  • Graduate or PhD students, early-career researchers, or professionals.
  • Expertise in AI and machine learning from academic or professional experience.
  • Curious about scientifically evaluating AI capabilities and safety.
  • Excited by rigorous research, interdisciplinary thinking, and real-world impact.

Programme Benefits

  • Full scholarship funded by Open Philanthropy including tuition, travel, and accommodation.
  • Access to an international faculty network and post-programme career pathways.
  • 15 ECTS Expert Diploma by ValgrAI - the Valencian Graduate School and Research Network of Artificial Intelligence.

Key skills/competency

  • AI Evaluation
  • AI Safety
  • Machine Learning
  • Research
  • Metrics
  • Testing
  • Governance
  • Policy
  • Red-Teaming
  • Experimental Design

How to Get Hired at International Programme on AI Evaluation: Capabilities and Safety

🎯 Tips for Getting Hired

  • Research International Programme on AI Evaluation: Understand programme goals and mission.
  • Customize your resume: Highlight AI research and technical skills.
  • Prepare for rigorous interviews: Review AI evaluation methods and safety protocols.
  • Showcase interdisciplinary thinking: Demonstrate research and practical project experience.

📝 Interview Preparation Advice

Technical Preparation

Review large language models architecture.
Study experimental design and metrics.
Practice adversarial testing techniques.
Refresh AI safety research methods.

Behavioral Questions

Describe interdisciplinary project experiences.
Explain teamwork during rigorous research.
Discuss handling academic challenges.
Share examples of resilience in research.

Frequently Asked Questions