Rubric Expert
@ Mercor

Hybrid
$100,000
Hybrid
Contractor
Posted 18 hours ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXXXX XXXXXXXXXXX XXXXXXX******* @mercor.com
Recommended after applying

Job Details

Company Introduction

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

Position: Rubric ExpertCommitment: Flexible hoursThis role focuses on enhancing AI models' ability to generate effective responses to user-generated images and prompts.

Responsibilities

  • Develop detailed rubrics to describe AI-generated responses.
  • Evaluate AI model outputs for visual prompt responses.
  • Collaborate with AI research teams to improve content quality.
  • Work independently and asynchronously to meet project goals.

Requirements / Qualifications

Must-Have: Experience in evaluating AI-generated content, ability to write clear evaluation rubrics, strong understanding of AI model outputs.

Preferred: Experience collaborating with AI research teams and a background in STEM or related fields.

Engagement Details

Contract Type: ContractLocation: RemoteSchedule: Flexible hours

Application Process

Upload resume, complete an AI interview based on your resume, and submit a form (takes 20-30 minutes).

Resources & Support

For interview process details, visit this link.For help, email: support@mercor.com

Key skills/competency

  • AI Evaluation
  • Rubric Development
  • Content Analysis
  • AI Research Collaboration
  • Independent Work
  • STEM Background
  • Flexible Scheduling
  • Detail Oriented
  • Clear Communication
  • Project Management

How to Get Hired at Mercor

🎯 Tips for Getting Hired

  • Research Mercor's culture: Understand their mission and investor background.
  • Customize your resume: Highlight AI and rubric expertise.
  • Prepare for AI interviews: Review past projects and outcomes.
  • Showcase collaboration: Emphasize teamwork with AI research teams.

📝 Interview Preparation Advice

Technical Preparation

Review AI evaluation methodologies.
Study rubric development techniques.
Familiarize with AI output analysis.
Practice remote collaboration tools.

Behavioral Questions

Describe independent work scenarios.
Explain collaboration with research teams.
Discuss handling flexible schedules.
Share experience solving AI challenges.

Frequently Asked Questions