Healthcare Expert

Healthcare Expert Role Overview

One of our clients, a leading AI research organization, is developing advanced conversational AI systems used in healthcare and medical contexts. In the Healthcare Expert role, you will evaluate and improve how these systems respond to clinical and health-related questions, ensuring outputs are accurate, clear, safe, and aligned with real-world healthcare standards.

Key Responsibilities

• Write and refine prompts guiding AI behavior in healthcare scenarios.
• Evaluate AI-generated responses for accuracy, clarity, reasoning, and completeness.
• Verify medical claims using trusted public sources and authoritative references.
• Annotate and score model outputs by identifying strengths and weaknesses.
• Assess tone, appropriateness, and completeness of responses for healthcare communication.
• Ensure outputs align with system guidelines and conversational standards.
• Apply standardized evaluation frameworks, taxonomies, and benchmarks consistently.

Required Qualifications

At least 5 years of professional experience in healthcare with an advanced healthcare-related degree or credential (e.g., MD, DO, RN, NP, PA, PharmD, MPH or equivalent). Expertise in general clinical care, specialty medicine, diagnostics, imaging, laboratory medicine, public health, healthcare systems or administration, and strong familiarity with large language models (LLMs).

Preferred Qualifications

• Experience with RLHF, AI evaluation, or data annotation.
• Background in medical writing, editing, or clinical documentation.
• Experience explaining medical information to non-clinical audiences.
• Familiarity with structured evaluation rubrics or quality scoring systems.

What Success Looks Like

Your keen eye for identifying inaccuracies and unsafe reasoning will improve AI output safety and clarity. High-quality and reproducible evaluation data is expected, boosting overall model performance.

Contract & Payment Terms

This is an independent contractor engagement with full remote work and flexible scheduling. Weekly payments are issued via Stripe or Wise. Engagement scope may vary based on performance and client needs; no access to confidential or proprietary employer data is required. H1-B and STEM OPT sponsorship are not available.

Application Process

Submit your resume for review. Selected candidates will complete a short healthcare-focused evaluation or screening form.

Key skills/competency

• Healthcare
• AI evaluation
• Medical accuracy
• Prompt writing
• Data annotation
• Clinical expertise
• Evaluation frameworks
• Communication skills
• Attention to detail
• Healthcare standards