PitchMeAI Jobs
Blueprint Technologies

AI Response Labeler / Annotator – Italian Specialty

Blueprint Technologies · Remote

Posted 8 days ago · $14.42 - $16.38

or apply directly on Blueprint Technologies's site. We never take the application ourselves.

Is this posting real?

This role has been open
8 days
Blueprint Technologies's roles stay open a median of 21 days
Reposted
No
Salary listed
Yes
57% of Blueprint Technologies's roles list one
Ghost-job risk at Blueprint Technologies
moderate
16 stale, 2 reposted of 58 open
Hiring momentum
107 roles opened in the last 90 days
↑ up vs. the prior 90 days
Last confirmed on the employer's board
2026-09-17

Measured from postings appearing on and disappearing from Blueprint Technologies's own greenhouse board since 2026-08-03. Full hiring picture for Blueprint Technologies.

About this role

The AI Response Labeler / Annotator role involves evaluating AI-generated responses primarily in Italian, assessing their quality across various dimensions such as factual accuracy, relevance, and clarity. The position requires performing side-by-side comparisons of responses, applying detailed annotation guidelines, and documenting decisions clearly. Candidates will need to maintain high productivity while ensuring accuracy in their evaluations.

Our read on this posting4.0out of 5
benefits
3/5
freshness
5/5
career value
3/5
role clarity
4/5
pay transparency
5/5

Scored from the posting itself — how clearly the role is described, how much it says about pay and benefits, and how recently it was listed. Not a judgement of Blueprint Technologies as an employer.

What you need

  • Native-level or professional fluency in Italian
  • Strong English fluency and reading comprehension
  • Strong analytical and critical-thinking skills
  • Ability to evaluate content across varied topics and formats
  • Ability to assess factuality, relevance, reasoning, clarity, and overall usefulness
  • Strong written communication skills

Nice to have

  • Experience performing side-by-side labeling, annotation, or quality assessment
  • Experience evaluating AI-generated responses
  • Experience with data labeling or annotation
  • Experience evaluating search relevance or content quality
  • Experience working with detailed guidelines or structured decision-making frameworks

What you get

  • Medical, dental, and vision coverage
  • Flexible Spending Account (FSA)
  • 401(k) retirement plan
  • Competitive paid time off
  • Parental leave
  • Professional growth and development opportunities

Worth weighing

  • Role involves highly structured and repetitive tasks
  • Candidates must complete a minimum of 25 tasks per day
  • Training and qualification program required before production work
  • Compensation is based on local market conditions and experience

Summarised from Blueprint Technologies's posting. Read the full original.

Listed by Blueprint Technologies on their greenhouse job board, last confirmed open on 2026-09-17. PitchMeAI is not the employer.

More roles at Blueprint Technologies

All 58 open roles at Blueprint Technologies →