Writing Expert
Mercor
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
About Mercor
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
This is a freelance opportunity for a Writing Expert at Mercor, focusing on AI model training and evaluation. This role is remote, based in the US or Canada, for a duration of 2 months with a commitment of 20 hours per week.
Role Responsibilities
- Design and optimize prompts with multiple constraints and instructions.
- Define and document evaluation standards for correct responses in general consumer contexts.
- Develop comprehensive rubrics for assessing AI model outputs.
- Conduct model testing and grading by running prompts through models and evaluating outputs against expectations.
- Support benchmarking and quality assurance by collaborating in QA review processes.
- Ensure prompt tasks and rubrics meet rigor and maintain consistency before integration into official benchmarks.
- Work independently and meet deadlines while contributing to AI model training and evaluation.
Qualifications
Must-Have
- BS or BA from a reputable institution completed or in progress.
- Strong writing and critical thinking skills.
- Ability to work independently and meet deadlines.
- Significant familiarity with ChatGPT or similar AI tools for personal decision-making or hobbies/general interests.
- Based in the US or Canada.
Preferred
- Experience in teaching or research.
Application Process
The application process takes approximately 20–30 minutes to complete:
- Complete an AI-led interview (around 15 minutes).
- Complete a 45-minute written assessment focused on writing rubrics.
- If selected, you will be invited to work on the project.
Resources & Support
For details about the interview process and platform information, please visit: https://talent.docs.mercor.com/welcome/welcome
For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Key skills/competency
- Prompt Engineering
- AI Model Evaluation
- Rubric Development
- Technical Writing
- Critical Thinking
- Quality Assurance
- ChatGPT Familiarity
- Independent Work
- Deadline Management
- Research Skills
How to Get Hired at Mercor
- Research Mercor's mission: Study their commitment to connecting talent with AI research labs and their investor backing to understand their vision.
- Tailor your resume: Highlight prompt design, AI model evaluation, and rubric development experience relevant to the Writing Expert role.
- Showcase AI tool familiarity: Emphasize your practical experience with ChatGPT or similar large language models in your application.
- Prepare for the AI interview: Practice articulating your writing, critical thinking, and independent work skills effectively in an automated interview setting.
- Demonstrate strong rubric creation: Focus on clarity, comprehensiveness, and logical structure for the written assessment on rubric development.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background