Knowledge Evaluator

@ Crossing Hurdles

Overview

Crossing Hurdles, a recruitment firm, refers top candidates to work with the world’s leading AI research labs in building and training cutting-edge AI models. The role is a General Knowledge Evaluator focusing on multidisciplinary content.

Position Details

Type: Hourly ContractCompensation: $20-$35 per hourLocation: RemoteDuration: Minimum of 1–2 months, with potential for extension.

Role Responsibilities

• Evaluate the accuracy, clarity, and reasoning of model-generated content.
• Assess diverse topics including science, humanities, social science, and current affairs.
• Complete structured evaluations using an 8–10 question rubric.
• Provide concise written comments explaining each judgment.
• Identify factual inaccuracies, reasoning flaws, or unclear explanations.
• Work independently and asynchronously using provided tools and guidelines.

Requirements

• PhD or current PhD candidate in a relevant multidisciplinary field.
• Strong generalist knowledge across academic and intellectual domains.
• Excellent critical thinking and writing skills.
• Attention to detail and ability to work independently in a remote environment.
• Basic understanding of Python or willingness to learn (preferred but not required).

Application Process

• Submit your resume for consideration.
• Complete the Preference Selection Calibration Assessment.
• Expect a typical application review response time of 3–5 business days.

Key skills/competency

• Evaluation
• AI
• Multidisciplinary
• Content Review
• Critical Thinking
• Research
• Accuracy
• Remote Working
• Python
• Calibration