Financial AI Evaluator
Mercor
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
About the Role of Financial AI Evaluator at Mercor
Mercor specializes in connecting top-tier creative and technical talent with leading AI research labs. Headquartered in San Francisco, Mercor is backed by prominent investors including Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
This contract position as a Financial AI Evaluator offers an hourly compensation of $105 and is fully remote.
Role Responsibilities
- Write and refine prompts to guide model behavior in financial contexts.
- Evaluate LLM-generated responses to finance-related queries for accuracy and clarity.
- Conduct fact-checking using trusted public sources and financial references.
- Annotate model responses by identifying strengths and areas for improvement.
- Assess tone and appropriateness of responses for real-world financial use cases.
- Apply consistent evaluation standards by following clear taxonomies and guidelines.
Qualifications
Must-Have
- 5+ years of professional experience in Finance.
- Bachelor's, Master's, or PhD degree in Finance, Accounting, Economics, or related fields.
- Experience in Investment Banking, Corporate Finance, Accounting & Auditing, or Asset Management.
- Significant experience using large language models.
- Excellent writing skills and strong attention to detail.
Preferred
- Experience with RLHF, model evaluation, or data annotation.
- Experience writing or editing high-quality financial content.
- Familiarity with evaluation rubrics or quality scoring systems.
Application Process
The application process is designed to take approximately 20-30 minutes and includes the following steps:
- Upload resume
- AI interview based on your resume
- Submit form
Our team actively reviews applications daily. To be considered, please ensure all AI interview and application steps are completed.
Resources & Support
For detailed information regarding the interview process and platform specifics, please visit: https://talent.docs.mercor.com/welcome/welcome
For any assistance or support, you can reach out to: support@mercor.com
Key skills/competency
- Financial Analysis
- Large Language Models (LLM)
- Prompt Engineering
- Data Annotation
- Fact-Checking
- Financial Reporting
- Investment Banking
- Corporate Finance
- Economics
- Attention to Detail
How to Get Hired at Mercor
- Research Mercor's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor.
- Tailor your resume: Customize your resume to highlight financial expertise, LLM experience, and attention to detail.
- Prepare for the AI interview: Practice answering finance-specific questions and demonstrating your analytical skills.
- Showcase domain expertise: Emphasize experience in investment banking, corporate finance, or asset management.
- Highlight relevant skills: Focus on prompt engineering, model evaluation, data annotation, and strong writing abilities.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background