PitchMeAI
Mercor

Rubrics Grader - Fully Remote | Upto $175/hr

Mercor · United States

  • Remote
  • Part-time
Tailored resumekeyword-matched to this role.
Hiring managerwe find who's hiring.
Intro emaildrafted to reach them directly.

About the role

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: JSON-fluent & Rubrics Expert

Type: Contract

Compensation: $50–$175/hour

Location: Remote

Role Responsibilities

  • Evaluate model outputs against defined grading rubrics to ensure accuracy and consistency.
  • Parse, read, and understand JSON-based outputs for grading purposes.
  • Review task descriptions and rubrics to maintain grading standards.
  • Work independently and complete tasks within 12–24 hours.
  • Ensure attention to detail and consistency in applying rubric criteria.

Qualifications

Must-Have

  • Available to start this weekend (Sat, July 25).
  • Comfortable reading and interpreting JSON files.
  • Based in the US.

Preferred

  • Prior experience with Mercor and applying detailed rubrics.

Start Date

  • Saturday, July 25; applications reviewed on a rolling basis.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

,