Rubric Creation Expert

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position Overview

The Rubric Creation Expert role is a contract position with a commitment of 30–40 hours per week. The role is fully remote and offers hourly compensation between $40 and $45.

Role Responsibilities

• Create and evaluate rubrics for user-generated shopping tasks to enhance AI model performance.
• Simulate realistic consumer behavior through prompt design to improve AI-generated content.
• Ensure outputs align with quality standards and task objectives to elevate training data quality.
• Collaborate asynchronously with the AI lab to refine rubric coverage and ensure consistency.

Qualifications

Must-Have: Prior experience designing or using structured rubrics for data collection or evaluation; familiarity with AI training, evaluation, or prompt engineering tasks; excellent attention to detail; strong written communication and organizational skills.

Start Date & Application Process

Immediate availability required. Express interest by confirming availability and experience. Expect a brief discussion or call to align on project expectations. Selected candidates will begin task work within 24 hours.

Resources & Support

For details about the interview process and platform information, please visit: Interview Process. For any help or support, reach out to: support@mercor.com.

Key skills/competency

rubric, evaluation, AI, prompt, simulation, quality, consistency, collaboration, communication, data