Healthcare Expert Remote
Keystone Recruitment
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Job Description
Overview
The Healthcare Expert Remote role involves evaluating and improving conversational AI systems used in healthcare contexts. You will write and refine prompts, evaluate AI-generated responses, verify medical claims, and annotate model outputs to ensure accuracy, clarity, and safety.
Key Responsibilities
- Write and refine prompts for healthcare AI behavior
- Evaluate responses for accuracy, clarity, and completeness
- Verify medical claims using trusted sources
- Annotate and score model outputs for clinical accuracy
- Assess tone and appropriateness for healthcare communication
- Ensure outputs align with defined guidelines and standards
- Apply evaluation frameworks and benchmarks consistently
Required Qualifications
- Minimum 5 years professional healthcare experience
- Advanced healthcare-related degree or credential (MD, DO, RN, etc.)
- Expertise in clinical care, specialty medicine, diagnostics or public health
- Familiarity with large language models and AI evaluations
- Excellent written communication for complex medical topics
- Exceptional attention to detail for clinical accuracy
Preferred Qualifications
- Experience with RLHF, AI evaluation, or data annotation
- Background in medical writing or clinical documentation
- Experience in explaining medical data to non-clinical audiences
- Familiarity with structured evaluation rubrics and quality scoring
What Success Looks Like
- Accurate identification of medical inaccuracies and unclear explanations
- Improved clarity, safety, and reliability of AI outputs
- Delivery of high-quality and reproducible evaluation data
Contract & Payment Terms
This is an independent contractor role with a fully remote work schedule, flexible hours, and weekly payments via Stripe or Wise. The engagement is hourly with rates between USD 150-190/hour. Sponsorship (H1-B/STEM OPT) is not available.
Application Process
Submit your resume for review. Selected candidates will complete a healthcare-focused evaluation or screening form.
Key skills/competency
- healthcare
- medical
- AI
- evaluation
- prompt
- LLM
- clinical
- accuracy
- annotation
- documentation
How to Get Hired at Keystone Recruitment
- Customize your resume: Emphasize healthcare expertise and AI evaluation.
- Highlight qualifications: Feature advanced healthcare credentials prominently.
- Research Keystone Recruitment: Understand their vision and recent projects.
- Prepare examples: Demonstrate past successes in clinical verifications.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background