Math Expert

Role: Math Expert

One of Taskify AI's clients, a leading AI research organization, is dedicated to enhancing the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are crucial across various professional and everyday scenarios, demanding clear reasoning, accuracy, and helpful explanations. This project specifically targets the evaluation and improvement of how AI models handle mathematical problems, explanations, and proofs across foundational and advanced mathematical domains.

What You’ll Do

• Write and refine prompts to guide AI model behavior in mathematical contexts.
• Evaluate large language model (LLM) responses to mathematics-related queries for correctness, rigor, and logical coherence.
• Verify mathematical claims, derivations, and proofs using deep domain expertise.
• Conduct fact-checking using authoritative public sources and mathematical knowledge.
• Annotate model responses by identifying strengths, weaknesses, and factual or conceptual errors.
• Assess clarity, structure, and suitability of explanations for different audience levels.
• Ensure outputs align with expected conversational standards and evaluation guidelines.
• Apply consistent evaluation frameworks, benchmarks, and taxonomies across tasks.

Who You Are

• PhD in Mathematics or a closely related field.
• Demonstrated expertise in Probability & Statistics, with experience in one or more of: Algebra & Number Theory, Calculus & Analysis, Geometry & Topology, Discrete Mathematics, Logic & Computation.
• Comfortable working with large language models and understanding real-world usage patterns.
• Excellent written communication skills with the ability to explain complex concepts clearly.
• Strong attention to detail and ability to identify subtle logical or conceptual issues.
• Experience reviewing, editing, or evaluating technical or academic writing.

Nice-to-Have Specialties

• Prior experience with RLHF, model evaluation, or data annotation.
• Teaching, mentoring, or explaining mathematics to non-expert audiences.
• Familiarity with structured evaluation rubrics, benchmarks, or review frameworks.

What Success Looks Like

In this Math Expert role, success means consistently identifying inaccuracies or weak reasoning in mathematical AI outputs. Your feedback will directly improve the rigor, correctness, and clarity of model responses. You will deliver reliable, reproducible evaluation artifacts that strengthen AI performance, ensuring Taskify AI's client's systems are trusted in mathematical contexts due to your rigorous evaluations.

Why Join This Project

This fully remote and flexible opportunity allows mathematicians to apply deep theoretical expertise to the evaluation and improvement of cutting-edge AI systems. You will directly influence how mathematical reasoning is represented and communicated at scale.

Contract and Payment Terms

• Engagement as an independent contractor.
• Fully remote with flexible scheduling.
• Projects may be extended, shortened, or concluded based on performance and project needs.
• Work will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are issued weekly via Stripe or Wise based on services rendered.
• H1-B and STEM OPT candidates cannot be supported at this time.

Key skills/competency

• Mathematics
• Artificial Intelligence (AI)
• Large Language Models (LLMs)
• Formal Reasoning
• Probability & Statistics
• Calculus & Analysis
• Algebra & Number Theory
• Logical Coherence
• Technical Writing Evaluation
• Data Annotation