Data Annotator
@ Crossing Hurdles

Hybrid
$93,600
Hybrid
Contractor
Posted 18 hours ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXX XXXXXXXXXXXXX XXXXXXXX***** @crossinghurdles.com
Recommended after applying

Job Details

Overview

Crossing Hurdles is a recruitment firm referring top candidates to leading AI research labs. The role is for a Data Annotator, working on training and evaluation of AI systems.

Position Details

Title: Data Annotator Expert / Tool Use Expert - AI Trainer

Type: Hourly Contract (Remote)

Compensation: $45/hr

Location: Remote

Duration: Flexible (10–40 hrs/week, 1-2 months, extension feasible)

Requirements

  • Excellent written communication with clear reference to rubrics.
  • Meticulous attention to detail and independent work capability.
  • Nice to have: familiarity with annotation tools, basic scripting (Python/SQL), and multilingual skills.

Key Responsibilities

  • Review model interaction logs for search tool invocation decisions.
  • Evaluate rewritten queries for clarity, specificity, and fidelity.
  • Provide concise, evidence-based rationales tied to rubric criteria.
  • Score query quality including intent capture and keyword selection.
  • Calibrate against gold examples and propose improvements.
  • Track decisions in a task portal maintaining high inter-rater agreement.
  • Flag sensitive content per safety guidelines.

Application Process

  • Upload resume.
  • Participate in a 10-minute AI interview.
  • Submit the application form.

Key skills/competency

  • Annotation
  • AI
  • Evaluation
  • Rubric
  • Detail
  • Python
  • SQL
  • Tool Use
  • Communication
  • Remote

How to Get Hired at Crossing Hurdles

🎯 Tips for Getting Hired

  • Customize your resume: Tailor skills and experience to AI roles.
  • Highlight attention detail: Emphasize precise annotation experience.
  • Show technical skills: Include any Python/SQL or similar experience.
  • Prepare for AI interviews: Review rubric and tool-use examples.

📝 Interview Preparation Advice

Technical Preparation

Review annotation software and tool guides.
Brush up on basic Python and SQL scripts.
Study rubric and evaluation criteria details.
Practice working with digital footprint logs.

Behavioral Questions

Describe your independent work style.
Explain handling ambiguous instructions effectively.
Give examples of detailed communication.
Discuss time management under flexible hours.

Frequently Asked Questions