Healthcare Expert
Keystone Recruitment
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Job Description
Overview
The Healthcare Expert role at Keystone Recruitment is a remote, independent contractor position focused on AI research in healthcare. This role involves evaluating and improving advanced conversational AI systems used for clinical and medical purposes.
Key Responsibilities
- Write and refine prompts guiding AI behavior in healthcare.
- Evaluate AI-generated responses for accuracy and clarity.
- Verify medical claims using trusted sources.
- Annotate and score model outputs for strengths and weaknesses.
- Assess tone, appropriateness, and completeness of responses.
- Apply evaluation frameworks, taxonomies, and benchmarks.
Required Qualifications
- Minimum 5 years professional experience in healthcare.
- Advanced healthcare degree or credential (MD, DO, RN, NP, PA, PharmD, MPH, etc.).
- Expertise in clinical care, specialty medicine, diagnostics, or public health.
- Strong familiarity with large language models in practical use.
- Excellent written communication for complex medical topics.
- Exceptional attention to detail for clinical and factual accuracy.
Preferred Qualifications
- Experience with RLHF, AI evaluation, or data annotation.
- Background in medical writing, editing, or clinical documentation.
- Experience explaining medical information to non-clinical audiences.
- Familiarity with structured evaluation rubrics or quality scoring systems.
What Success Looks Like
You consistently identify medical inaccuracies and provide actionable feedback to improve the quality and safety of healthcare-related AI outputs. High-quality, reproducible evaluation data is delivered to strengthen AI model performance.
Contract & Payment Terms
This is an independent contractor engagement with a fully remote work setup. The role offers flexible scheduling with weekly payments via Stripe or Wise. The scope may vary based on performance and client needs. Note: H1-B and STEM OPT sponsorship is not available.
Application Process
Submit your resume for review. Selected candidates will complete a short healthcare-focused evaluation or screening form.
Key skills/competency
- Healthcare
- AI
- Evaluation
- Annotation
- Clinical
- Communication
- Accuracy
- Prompt
- Research
- Standards
How to Get Hired at Keystone Recruitment
- Customize your resume: Emphasize healthcare and AI evaluation experience.
- Highlight credentials: Showcase advanced healthcare degrees.
- Research Keystone Recruitment: Understand their AI research focus and culture.
- Prepare samples: Demonstrate prompt writing and annotation skills.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background