Mathematics Expert

Job Summary: Mathematics Expert at Braintrust

Braintrust is seeking highly qualified Mathematics Experts to join a project focused on evaluating and refining AI-generated responses. This freelance, remote position involves a critical review of AI models' reasoning quality and step-by-step problem-solving capabilities in complex mathematical contexts. You will provide expert feedback to help these models produce accurate, logical, and clearly explained answers.

Key Responsibilities

• Review AI-generated mathematical responses, evaluating reasoning quality and problem-solving steps.
• Assess solutions for accuracy, clarity, and adherence to prompts.
• Identify errors in calculations, methodology, or conceptual understanding.
• Fact-check quantitative information across various sources.
• Write high-quality mathematical explanations and model solutions demonstrating correct methods.
• Rate and compare multiple AI responses based on mathematical correctness and reasoning quality.

Hiring Profile & Qualifications

We are looking for individuals who meet the following criteria:

• Hold a PhD in Mathematics, Statistics, or a closely related quantitative field.
• Possess experience in developing or critically reviewing complex math content, such as problem banks, proofs, textbook sections, or research notes.
• Have published work in a peer-reviewed journal.
• Demonstrate English proficiency at C1 level or above with excellent writing skills.
• Bonus: Experience with data labeling, Reinforcement Learning from Human Feedback (RLHF), or general AI model evaluation.

Commitment

A minimum commitment of 17–20 hours per week is expected. However, considering the project scope and timelines, a preferred and recommended commitment would be 8 hours per day.

Next Steps

If you are interested in this opportunity, please follow these steps:

• Apply via the partner site. Braintrust will send an email with detailed instructions.
• Complete a Qualification Exam (1–2 hours) to evaluate your role-specific expertise. Compensation will be provided upon passing.
• Complete a Project Exam (1–2 hours) to evaluate your adherence to project guidelines and ability to produce math-specific deliverables. Compensation will also be provided upon passing.

Key Skills/Competency

• Mathematical Reasoning
• AI Model Evaluation
• Problem Solving
• Quantitative Analysis
• Technical Writing
• Data Labeling
• Statistics
• Proofreading
• Critical Thinking
• Machine Learning (RLHF)