8 days ago

Healthcare Expert

Keystone Recruitment

Hybrid
Contractor
$360,000
Hybrid

Job Overview

Job TitleHealthcare Expert
Job TypeContractor
CategoryCommerce
Experience5 Years
DegreeMaster
Offered Salary$360,000
LocationHybrid

Who's the hiring manager?

Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Uncover Hiring Manager

Job Description

Healthcare Expert

Engagement: Hourly contract (independent contractor)Rate: USD 150-190/hourLocation: Remote – candidates based in the United States, United Kingdom, Canada, Europe, Singapore, Dubai, or Australia who are legally able to work as independent contractors in their jurisdiction.

Role Overview

One of our clients, a leading AI research organization, is developing advanced conversational AI systems used in healthcare and medical contexts. This role focuses on evaluating and improving how these systems respond to clinical and health-related questions, ensuring outputs are accurate, clear, safe, and aligned with real-world healthcare standards.

Key Responsibilities

  • Write and refine prompts that guide AI behavior in healthcare and medical scenarios
  • Evaluate AI-generated responses to healthcare-related queries for accuracy, clarity, reasoning, and completeness
  • Verify all medical claims using trusted public sources and authoritative references
  • Annotate and score model outputs by identifying strengths, weaknesses, and factual or clinical inaccuracies
  • Assess tone, appropriateness, and completeness of responses for real-world healthcare communication
  • Ensure all outputs align with defined system guidelines and conversational standards
  • Apply standardized evaluation frameworks, taxonomies, and benchmarks consistently

Required Qualifications

  • At least 5 years of professional experience in healthcare
  • An advanced healthcare-related degree or credential (e.g., MD, DO, RN, NP, PA, PharmD, MPH, or equivalent)
  • Expertise in one or more of the following areas:
    • General clinical care
    • Specialty medicine or surgery
    • Diagnostics, imaging, or laboratory medicine
    • Public health, healthcare systems, or healthcare administration
  • Strong familiarity with large language models (LLMs) and how they are used in practice
  • Excellent written communication skills for complex medical topics
  • Exceptional attention to detail and ability to detect subtle clinical or factual errors

Preferred Qualifications

  • Experience with RLHF, AI evaluation, or data annotation
  • Background in medical writing, editing, or clinical documentation
  • Experience explaining medical information to non-clinical audiences
  • Familiarity with structured evaluation rubrics or quality scoring systems

What Success Looks Like

  • You consistently identify medical inaccuracies, unsafe reasoning, or unclear explanations
  • Your feedback improves the reliability, clarity, and safety of healthcare-related AI outputs
  • You deliver high-quality, reproducible evaluation data that strengthens AI model performance

Contract & Payment Terms

  • Independent contractor engagement
  • Fully remote with flexible scheduling
  • Weekly payments via Stripe or Wise
  • Project scope and duration may vary based on performance and client needs
  • No access to confidential or proprietary employer data is required
  • H1-B and STEM OPT sponsorship is not available

Application Process

  • Submit your resume for review
  • Selected candidates will complete a short healthcare-focused evaluation or screening form

Key skills/competency

  • Healthcare Expertise
  • AI Evaluation
  • Clinical Accuracy
  • Medical Content
  • Prompt Engineering
  • Data Annotation
  • Quality Assurance
  • Health Standards
  • Large Language Models (LLMs)
  • Detail Orientation

Tags:

Healthcare Expert
AI Evaluation
Clinical Accuracy
Medical Content
Prompt Engineering
Data Annotation
Quality Assurance
Health Standards
Factual Verification
Communication
Error Detection
Large Language Models (LLMs)
Conversational AI
AI Systems
Natural Language Processing
Machine Learning
AI Evaluation Frameworks
Prompt Design
RLHF
AI Safety

Share Job:

How to Get Hired at Keystone Recruitment

  • Research Keystone Recruitment's client: Study the AI research organization's mission, values, recent news, and advancements in conversational AI for healthcare.
  • Tailor your resume: Highlight your 5+ years of healthcare experience, advanced medical degrees (MD, RN, PharmD), and specific expertise in clinical care or public health. Emphasize LLM familiarity.
  • Showcase medical writing expertise: Prepare examples demonstrating exceptional written communication for complex medical topics and the ability to explain information to non-clinical audiences.
  • Prepare for AI evaluation tasks: Familiarize yourself with AI response evaluation principles, quality scoring systems, and data annotation methodologies.
  • Emphasize attention to detail: Be ready to provide specific examples of your meticulous approach to detecting subtle clinical or factual errors in medical content.

Frequently Asked Questions

Find answers to common questions about this job opportunity

Explore similar opportunities that match your background