Physics Expert

Physics Expert

One of Taskify AI's clients, a leading AI research organization, is dedicated to enhancing the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are crucial across various professional and everyday scenarios, with their efficacy heavily reliant on accuracy, clarity, and sound reasoning. For physics-related applications, AI systems must exhibit strong theoretical foundations, quantitative precision, and accurate scientific reasoning. This project specifically aims to evaluate and improve how AI models explain, reason about, and respond to physics questions, covering both fundamental and advanced domains.

What You’ll Do

• Write and refine prompts to guide AI model behavior in physics contexts.
• Evaluate large language model (LLM) responses to physics-related queries for conceptual accuracy, mathematical correctness, and reasoning quality.
• Conduct fact-checking using authoritative sources and deep domain expertise.
• Annotate model responses by identifying strengths, weaknesses, and factual or conceptual errors.
• Assess clarity, structure, and suitability of explanations for different audience levels.
• Ensure outputs align with conversational standards and rigorous evaluation guidelines.
• Apply consistent evaluation frameworks, benchmarks, and taxonomies across all tasks.

Who You Are

• PhD in Physics or a closely related field.
• Deep expertise in one or more of the following subdomains: Classical Mechanics & Dynamics, Electromagnetism, Optics & Signals, Thermodynamics & Statistical Physics, Quantum Physics, Relativity, Cosmology & High-Energy Physics.
• Comfortable working with large language models and understanding real-world usage patterns.
• Excellent written communication skills with the ability to clearly explain complex physics concepts.
• Strong attention to detail and ability to identify subtle conceptual or mathematical issues.
• Experience reviewing, editing, or evaluating technical or academic writing.

Nice-to-Have Specialties

• Prior experience with RLHF, model evaluation, or data annotation.
• Experience teaching or explaining physics concepts to non-expert audiences.
• Familiarity with structured evaluation rubrics, benchmarks, or review frameworks.

What Success Looks Like

You consistently identify conceptual inaccuracies or weak reasoning in physics-related AI outputs. Your feedback significantly improves the rigor, clarity, and correctness of model explanations. You deliver reliable, reproducible evaluation artifacts that strengthen model performance, ultimately ensuring Taskify AI's client's AI systems are trusted in scientific contexts due to your rigorous evaluations.

Why Join This Project

This opportunity allows PhD-level physicists to apply deep scientific expertise to the evaluation and improvement of advanced AI systems. The role is fully remote and offers flexible scheduling, enabling you to contribute to high-impact AI development while maintaining control over your personal schedule.

Key skills/competency

• AI Model Evaluation
• Physics Concepts
• Scientific Reasoning
• Mathematical Correctness
• Fact-Checking
• Prompt Engineering
• Large Language Models (LLMs)
• Technical Writing
• Data Annotation
• Quality Assurance