Data Science Specialist
Referral By NK · United States
- Hybrid
- Contract
- $170,000 / year
- United States
Tailored resume — keyword-matched to this role.
Hiring manager — we find who's hiring.
Intro email — drafted to reach them directly.
Job highlights
- Evaluate AI systems' data science performance.
- Design grading criteria for data science tasks.
- Score AI and human work samples.
- Provide detailed written justifications for scores.
- Collaborate remotely on AI training projects.
About the role
Data Science Specialist
We are a referral partner, Mercor, is partnering with a leading AI research organization to engage experienced data scientists for a project focused on evaluating how well AI systems perform real-world data science work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.
Key Responsibilities
- Design precise, task-specific grading criteria for real-world data science deliverables (analyses, models, dashboards, experiment readouts, and written recommendations).
- Score AI-generated and human work samples against those criteria, with detailed written justifications for every score.
- Apply consistent, evidence-based judgment so that scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
Ideal Qualifications
- 5+ years of professional data science experience in industry.
- Background in business operations, product, or growth data science at top-tier technology companies.
- Deep fluency in experiment design and A/B testing, metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
- Exceptionally strong written communication.
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
- Prior experience with AI training, evaluation, or human-data projects is a strong plus.
Application Process
- Submit your resume or relevant technical background to get started.
- Qualified applicants may be asked to complete a brief technical assessment or submit additional information.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms
- You will be engaged as an independent contractor.
- This is a fully remote role that can be completed on your own schedule.
- Projects can be extended, shortened, or concluded early depending on needs and performance.
- Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
- Payments are weekly on Stripe or Wise based on services rendered.
- Please note: We are unable to support H1-B or STEM OPT candidates at this time.
About Mercor
Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise.
Key skills/competency
- Data Science
- AI Evaluation
- Experiment Design
- A/B Testing
- SQL
- Python
- Metric Definition
- Written Communication
- Business Operations
- Product Data Science
Skills & topics
- Data Science Specialist
- AI evaluation
- Data science tasks
- Grading criteria
- Work sample scoring
- SQL
- Python
- A/B testing
- Metric definition
- Remote contract
How to get hired
- Tailor your resume: Highlight 5+ years of data science experience, business operations, product, or growth data science at tech companies.
- Showcase technical skills: Emphasize fluency in experiment design, A/B testing, metric definition, SQL, Python analysis, and executive communication.
- Demonstrate communication: Highlight exceptionally strong written communication skills and experience with AI evaluation or human-data projects.
- Prepare for assessment: Be ready for a potential technical assessment or to submit additional information.
- Understand the role: Focus on evaluation and scoring, not direct deliverable production.
Technical preparation
Master experiment design and A/B testing.,Refine SQL and Python analytical skills.,Practice defining clear metrics.,Prepare to justify data-driven decisions.
Behavioral questions
How do you ensure consistent grading?,Describe a time judgment was reviewed.,How do you communicate complex findings?,How do you iterate on feedback?
Frequently asked questions
- What is the role of a Data Science Specialist at Mercor?
- As a Data Science Specialist for Mercor, you will evaluate AI systems' performance on real-world data science tasks. Your primary responsibilities include designing grading criteria, scoring work samples, and providing detailed written justifications for those scores, rather than producing direct deliverables yourself.
- What are the key qualifications for the Data Science Specialist role?
- Ideal candidates for the Data Science Specialist role at Mercor possess over 5 years of professional data science experience, particularly in business operations, product, or growth at top tech companies. Strong proficiency in experiment design, A/B testing, metric definition, SQL/Python analysis, and exceptional written communication are essential.
- Is this a remote position, and what are the work arrangements?
- Yes, this Data Science Specialist role is fully remote, allowing you to complete your work on your own schedule. You will be engaged as an independent contractor with flexible project durations.
- How are Data Science Specialists compensated?
- Data Science Specialists are compensated hourly, with rates ranging from $120 to $170 per hour. Payments are processed weekly via Stripe or Wise based on services rendered.
- What is the application process for the Data Science Specialist role?
- To apply for the Data Science Specialist position, submit your resume or relevant technical background. Qualified applicants may be invited to complete a technical assessment or provide further information.
- Does Mercor support H1-B or STEM OPT candidates for this role?
- Unfortunately, Mercor is unable to support H1-B or STEM OPT candidates for this specific Data Science Specialist contract role at this time.
- What is Mercor's involvement in AI training?
- Mercor partners with leading AI labs to train frontier AI models using human expertise. As a Data Science Specialist, you'll contribute to projects focused on training and enhancing these AI systems.
- Will I handle confidential information as a Data Science Specialist?
- No, your work as a Data Science Specialist at Mercor will not involve access to any confidential or proprietary information from employers, clients, or institutions.