Rubric Expert
@ Mercor

Hybrid
$80,000
Hybrid
Contractor
Posted 6 hours ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXX XXXXXXXXXXX XXXXXXXX***** @mercor.com
Recommended after applying

Job Details

Company Introduction

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

Position: Human Data Project Expert – Contract, RemoteCommitment: Flexible hours

This role focuses on enhancing AI models' ability to generate effective responses to user-generated images and prompts.

Responsibilities

  • Develop detailed rubrics that outline AI-generated responses.
  • Evaluate the effectiveness of AI model outputs for visual prompts.
  • Collaborate with AI research teams to refine content quality.
  • Work independently and asynchronously to meet project goals.

Requirements / Qualifications

Must-Have: Experience in evaluating AI-generated content, ability to write detailed and clear evaluation rubrics, strong understanding of AI model outputs and their applications.

Preferred: Experience collaborating with AI research teams and a background in STEM or related fields.

Engagement Details

Contract Type: ContractLocation: RemoteSchedule: Flexible hours

Application Process

  • Upload resume
  • Complete an AI interview based on your resume
  • Submit form

For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome

For support, reach out to: support@mercor.com

Key skills/competency

  • AI evaluation
  • Rubric development
  • Content analysis
  • Collaboration
  • Independence
  • STEM
  • Data assessment
  • Research
  • Communication
  • Remote work

How to Get Hired at Mercor

🎯 Tips for Getting Hired

  • Research Mercor's culture: Study their mission, values, and funding background.
  • Customize your resume: Match AI evaluation and rubric expertise.
  • Showcase collaboration: Emphasize teamwork with AI experts.
  • Prepare for AI interviews: Highlight technical and analytical skills.

📝 Interview Preparation Advice

Technical Preparation

Review AI output analysis techniques.
Study rubric development strategies.
Understand AI evaluation metrics.
Brush up on image analysis methods.

Behavioral Questions

Describe handling independent work challenges.
Explain remote team collaboration experience.
Discuss problem-solving with ambiguous data.
Share past experiences in time management.

Frequently Asked Questions