Physicist @ Mercor
Your Application Journey
Email Hiring Manager
Job Details
Company Introduction
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Role Overview
Position: STEM Expert – Contract, Remote Commitment: 20 hours per week Duration: 1 month
Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry.
Responsibilities
- Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions.
- Define and Document Evaluation Standards: Establish high-level expectations for correct responses in STEM contexts and develop a comprehensive rubric.
- Conduct Model Testing and Grading: Run prompts through models and assess preliminary outputs against expectations.
- Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure task and rubric consistency before integration into official benchmarks.
Requirements / Qualifications
Must-Have: BS or BA in Biology, Physics, or Chemistry; Familiarity with undergraduate-level STEM topics; Strong writing and critical thinking skills; Ability to work independently and meet deadlines.
Preferred: 2+ years of experience in teaching, research, or applied STEM discipline.
Engagement Details
Remote and asynchronous role with a 20-hour per week commitment for a duration of 1 month in a structured project environment with clear goals and tools.
Application Process
Complete an AI-led interview (approximately 15 minutes) and a 45-minute written assessment. If selected, you will be invited to work on the project.
Resources & Support
For interview process details and platform information, please check: Talent Docs. For any help or support, reach out to: support@mercor.com.
Key skills/competency
- AI
- STEM
- Evaluation
- Rubric
- Prompt Design
- Quality Assurance
- Scientific
- Testing
- Research
- Critical Thinking
How to Get Hired at Mercor
🎯 Tips for Getting Hired
- Customize your resume: Tailor your STEM experiences and skills.
- Highlight AI expertise: Emphasize prompt design and evaluation work.
- Prepare for assessments: Practice written tests and AI interviews.
- Review Mercor details: Research the company using LinkedIn and Glassdoor.