3 days ago
Healthcare Expert
Keystone Recruitment
Hybrid
Contractor
$340,000
Hybrid
Job Overview
Job TitleHealthcare Expert
Job TypeContractor
CategoryCommerce
Experience5 Years
DegreeMaster
Offered Salary$340,000
LocationHybrid
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Job Description
Role Overview
One of our clients, a leading AI research organization, is developing advanced conversational AI systems used in healthcare and medical contexts. This Healthcare Expert role focuses on evaluating and improving how these systems respond to clinical and health-related questions, ensuring outputs are accurate, clear, safe, and aligned with real-world healthcare standards.
Key Responsibilities
- Write and refine prompts that guide AI behavior in healthcare and medical scenarios
- Evaluate AI-generated responses to healthcare-related queries for accuracy, clarity, reasoning, and completeness
- Verify all medical claims using trusted public sources and authoritative references
- Annotate and score model outputs by identifying strengths, weaknesses, and factual or clinical inaccuracies
- Assess tone, appropriateness, and completeness of responses for real-world healthcare communication
- Ensure all outputs align with defined system guidelines and conversational standards
- Apply standardized evaluation frameworks, taxonomies, and benchmarks consistently
Required Qualifications
- At least 5 years of professional experience in healthcare
- An advanced healthcare-related degree or credential (e.g., MD, DO, RN, NP, PA, PharmD, MPH, or equivalent)
- Expertise in one or more of the following areas:
- General clinical care
- Specialty medicine or surgery
- Diagnostics, imaging, or laboratory medicine
- Public health, healthcare systems, or healthcare administration
- Strong familiarity with large language models (LLMs) and how they are used in practice
- Excellent written communication skills for complex medical topics
- Exceptional attention to detail and ability to detect subtle clinical or factual errors
Preferred Qualifications
- Experience with RLHF, AI evaluation, or data annotation
- Background in medical writing, editing, or clinical documentation
- Experience explaining medical information to non-clinical audiences
- Familiarity with structured evaluation rubrics or quality scoring systems
What Success Looks Like
- You consistently identify medical inaccuracies, unsafe reasoning, or unclear explanations
- Your feedback improves the reliability, clarity, and safety of healthcare-related AI outputs
- You deliver high-quality, reproducible evaluation data that strengthens AI model performance
Contract & Payment Terms
- Independent contractor engagement
- Fully remote with flexible scheduling
- Weekly payments via Stripe or Wise
- Project scope and duration may vary based on performance and client needs
- No access to confidential or proprietary employer data is required
- H1-B and STEM OPT sponsorship is not available
Application Process
- Submit your resume for review
- Selected candidates will complete a short healthcare-focused evaluation or screening form
Key skills/competency
- Healthcare Expertise
- AI Evaluation
- Clinical Accuracy
- Medical Writing
- Prompt Engineering
- LLM Familiarity
- Data Annotation
- Critical Thinking
- Regulatory Compliance
- Attention to Detail
How to Get Hired at Keystone Recruitment
- Research Keystone Recruitment's client: Study their mission in AI research, values, recent innovations, and the specific impact of their healthcare AI on the industry.
- Tailor your resume for AI healthcare: Highlight your 5+ years of healthcare experience, advanced medical degree, and any familiarity with LLMs or AI evaluation. Emphasize medical writing and critical analysis skills.
- Showcase your clinical expertise: During interviews, articulate specific examples where your clinical knowledge or medical writing skills directly contributed to improving accuracy or clarity in a professional setting.
- Demonstrate attention to detail: Be prepared to discuss your methodology for verifying medical claims and detecting subtle errors, as this is crucial for the Healthcare Expert role.
- Understand the independent contractor model: Familiarize yourself with the terms of hourly contract work, flexible scheduling, and payment via Stripe/Wise, ensuring it aligns with your professional goals.
Frequently Asked Questions
Find answers to common questions about this job opportunity
01What is the primary focus of the Healthcare Expert role at Keystone Recruitment's client?
02What kind of healthcare experience is essential for this Healthcare Expert position?
03Does this Healthcare Expert role require prior experience with AI or large language models?
04How will my medical claims verification skills be used in this Healthcare Expert role?
05What are the contractual terms for the Healthcare Expert position?
06What kind of communication skills are important for a Healthcare Expert working with AI?
07What does success look like in the Healthcare Expert role at Keystone Recruitment?
Explore similar opportunities that match your background