Rubric Expert
@ Mercor

Hybrid
$120,000
Hybrid
Contractor
Posted 4 hours ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXX XXXXXXXXXXXXX XXXXXXXXX***** @mercor.com
Recommended after applying

Job Details

Company Introduction

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

Position: Human Data Project Expert – Contract, Remote Commitment: Flexible hours This role focuses on enhancing AI models' ability to generate effective responses to user-generated images and prompts.

Responsibilities

  • Develop detailed rubrics describing AI-generated responses to uploaded images.
  • Evaluate the effectiveness of AI outputs interpreting visual prompts.
  • Collaborate with AI research teams to improve content quality.
  • Work independently and asynchronously to meet project goals.

Requirements / Qualifications

Must-Have Qualifications: Experience in evaluating AI-generated content; ability to write detailed evaluation rubrics; strong understanding of AI model outputs and applications.

Preferred Qualifications: Experience collaborating with AI research teams; background in STEM or related fields.

Engagement Details

Contract Type: Contract Location: Remote Schedule: Flexible hours

Application Process

Complete a 20-30 minute process by uploading your resume, participating in an AI interview, and submitting a form.

Resources & Support

For interview process details, visit this link. For any support, contact support@mercor.com.

Key skills/competency

  • AI Evaluation
  • Rubric Development
  • Content Analysis
  • Independent Work
  • Technical Writing
  • AI Models
  • Collaboration
  • STEM Knowledge
  • Detail Oriented
  • Asynchronous Work

How to Get Hired at Mercor

🎯 Tips for Getting Hired

  • Customize Resume: Tailor experience to rubric development skills.
  • Showcase Projects: Highlight AI evaluation and collaboration expertise.
  • Review Mercor Insights: Study company background and investor details.
  • Prepare for AI Interview: Practice responses on technical criteria.

📝 Interview Preparation Advice

Technical Preparation

Review AI model evaluation techniques.
Study rubric creation methods.
Practice technical writing samples.
Familiarize with AI research teamwork.

Behavioral Questions

Describe independent work experience.
Explain remote collaboration strategies.
Discuss handling feedback effectively.
Demonstrate problem solving in projects.

Frequently Asked Questions