Legal Expert
Keystone Recruitment
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Legal Expert at Keystone Recruitment
We are hiring on behalf of an advanced AI research organization working to improve the quality, reasoning, and reliability of large-scale conversational AI systems.
This project focuses on enhancing how AI systems respond to legal questions across professional and general-use scenarios. Your expertise will help ensure responses reflect sound legal reasoning, factual accuracy, and responsible communication aligned with real-world legal standards.
Role Overview
As a Legal Subject Matter Expert, you will evaluate and refine AI-generated legal responses. You will apply your professional legal judgment to assess reasoning quality, accuracy, clarity, and completeness in model outputs. This is a flexible, remote consulting opportunity suited for experienced legal professionals interested in contributing to the development of responsible AI systems.
Key Responsibilities
- Draft and refine prompts to guide AI behavior in legal scenarios
- Evaluate AI-generated responses to legal queries for accuracy, reasoning quality, and clarity
- Conduct fact-checking using authoritative public sources and recognized legal references
- Identify factual inaccuracies, flawed reasoning, omissions, or misleading explanations
- Assess tone and appropriateness of responses for real-world legal contexts
- Apply structured evaluation criteria using defined taxonomies and quality frameworks
- Provide reproducible, structured feedback to improve AI performance
Required Qualifications
- Minimum 5 years of professional legal experience
- Juris Doctor (JD), LLB, LLM, or equivalent legal qualification
- Experience in one or more of the following areas:
- Corporate, Business, or Commercial Law
- Employment, Labor, or Human Rights Law
- Public, Criminal, or International Law
- Private Law
- Strong analytical reasoning skills
- Excellent written communication skills in English
- Ability to clearly explain complex legal concepts
- Comfort evaluating nuanced legal arguments and identifying subtle reasoning gaps
Preferred Qualifications
- Experience working with AI systems or large language models
- Background in legal writing, editorial review, or academic publication
- Experience translating legal concepts for non-legal audiences
- Familiarity with structured evaluation frameworks, benchmarking, or quality scoring systems
- Prior experience in model evaluation, annotation, or feedback-based systems
What Success Looks Like
- Legal inaccuracies and reasoning gaps are consistently identified and documented
- AI-generated responses demonstrate improved clarity and legal precision
- Feedback is structured, objective, and reproducible
- AI systems become more reliable for legal-context use cases
Engagement Details
- Remote, flexible schedule
- Independent contractor engagement
- Compensation: $105 per hour
- Project duration may vary based on scope and performance
- Weekly payments via secure payment platform
Key skills/competency
- Legal analysis
- AI evaluation
- LLM refinement
- Legal research
- Fact-checking
- Legal writing
- Communication
- Reasoning
- Compliance
- Legal standards
How to Get Hired at Keystone Recruitment
- Understand Keystone Recruitment's role: Clarify whether applying directly to Keystone or their AI research organization client.
- Tailor your resume: Highlight extensive legal expertise and any experience with AI or technology evaluation for this Legal Expert role.
- Showcase legal reasoning: Prepare to discuss complex legal problem-solving and critical thinking in interviews.
- Demonstrate AI understanding: Be ready to articulate your perspectives on AI's impact on legal practice and ethics.
- Emphasize remote work readiness: Detail your experience and comfort with independent, flexible, remote collaboration tools and environments.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background