Research Scientist (Remote)
Jobs Ai · NAMER
- Hybrid
- Contract
- $145,600 / year
- NAMER
Job highlights
- Evaluate AI outputs for scientific accuracy.
- Apply rubrics to assess research rigor.
- Identify and report AI errors clearly.
- Collaborate with research and product teams.
- Work remotely in a flexible environment.
About the role
Research Scientist AI Evaluation
We are hiring Research Scientists to evaluate AI outputs related to scientific reasoning, research design, and domain expertise. In this role, you will apply structured rubrics to assess scientific rigor and contribute to AI model improvement on research tasks. The ideal candidate has research training and rigorous analytical thinking.
Key Responsibilities
- Evaluate AI-generated scientific reasoning, literature reviews, and research analysis.
- Apply structured rubrics to assess methodological rigor and accuracy.
- Identify reasoning errors, citation issues, and methodological gaps.
- File clean evaluation tickets with clear written justification.
- Partner with research and product teams on quality criteria.
- Contribute to rubric design for specific scientific domains.
Required Skills & Qualifications
- PhD or equivalent research experience in a STEM, life sciences, or social science field.
- Track record of peer-reviewed publications or research output.
- Strong understanding of research methodology and statistical reasoning.
- Clear written communication for academic and technical writing.
- Strong attention to detail and analytical rigor.
- Ability to work independently in a remote environment.
Preferred Qualifications
- Active research role at a university, lab, or industry research org.
- Experience evaluating AI or LLM output quality.
- Domain expertise in physics, chemistry, biology, math, or computer science.
- Experience with research tools (Python, R, MATLAB, statistical software).
- Background in peer review or grant evaluation.
What We Offer
- Remote and flexible work environment.
- Competitive pay with contract options and paths to full-time.
- Modern AI evaluation environments and active feedback loops.
- Collaborative and quality-focused team.
- Learning opportunities across scientific AI evaluation and rubric design.
Equal Opportunity Employer
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Key skills/competency
- AI Evaluation
- Research Scientist
- Scientific Reasoning
- Research Methodology
- Data Analysis
- STEM
- Life Sciences
- Social Sciences
- Technical Writing
- Remote Work
Skills & topics
- Research Scientist
- AI Evaluation
- Scientific Reasoning
- Research Methodology
- STEM
- Life Sciences
- Social Sciences
- Remote
- Data Analysis
- Technical Writing
How to get hired
- Tailor your resume: Highlight research experience and AI evaluation skills for this Research Scientist role.
- Showcase publications: Emphasize peer-reviewed publications and research output relevant to STEM fields.
- Demonstrate analytical rigor: Provide examples of your attention to detail and strong analytical capabilities.
- Highlight remote work success: Mention your ability to work independently in a remote setting.
- Prepare for technical questions: Be ready to discuss research methodology and statistical reasoning.
Technical preparation
Review research methodology principles.,Practice identifying logical fallacies.,Familiarize with statistical concepts.,Prepare to discuss research papers.
Behavioral questions
Describe a complex research problem you solved.,How do you ensure accuracy in your work?,How do you handle constructive criticism?,How do you manage tasks independently?
Frequently asked questions
- What specific AI outputs will I be evaluating as a Research Scientist at Jobs Ai?
- As a Research Scientist at Jobs Ai, you will evaluate AI-generated content related to scientific reasoning, literature reviews, and research analysis. Your work will directly contribute to improving the AI's understanding and generation of complex scientific information.
- What are the core qualifications for the Research Scientist (Remote) position at Jobs Ai?
- The core qualifications include a PhD or equivalent research experience in a STEM, life sciences, or social science field, a track record of peer-reviewed publications, a strong understanding of research methodology and statistical reasoning, clear written communication skills, and the ability to work independently in a remote environment.
- Is this a remote position, and what are the benefits of working remotely at Jobs Ai?
- Yes, this is a fully remote position. Jobs Ai offers a flexible and remote work environment, competitive pay, modern AI evaluation tools, and opportunities for professional growth in scientific AI evaluation.
- How does Jobs Ai use the evaluations from Research Scientists to improve its AI models?
- Your evaluations will be used to identify reasoning errors, citation issues, and methodological gaps in AI outputs. This feedback, along with your contributions to rubric design, directly informs the improvement of AI models for research tasks.
- What kind of domain expertise is preferred for the Research Scientist role at Jobs Ai?
- Preferred domain expertise includes physics, chemistry, biology, math, or computer science. However, strong candidates with research training and analytical skills in other STEM, life sciences, or social science fields are also encouraged to apply.
- How will my application be reviewed for the Research Scientist position at Jobs Ai?
- Your application will be reviewed based on demonstrated technical ability and qualifications, specifically your research experience, publications, understanding of research methodology, and analytical rigor. All qualified candidates are welcome regardless of background.