Financial Professional
Mercor · Mumbai Metropolitan Region
- Hybrid
- Part-time
- $75,000 / year
- Mumbai Metropolitan Region
Job highlights
- Evaluate AI responses for accuracy and usefulness.
- Apply finance expertise to AI-generated content.
- Identify misleading information and factual errors.
- Provide evidence-based justifications for evaluations.
- Part-time contract role with flexible hours.
About the role
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D\'Angelo, Larry Summers, and Jack Dorsey.Position: AI Model Evaluator
Type: Contract
Compensation: $50–$75/hour
Commitment: 20 hours/week
Role Responsibilities
- Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance.
- Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness.
- Identify fabricated claims, incorrect references, or misleading reasoning across model outputs.
- Score and rank multiple model responses using structured rubrics across dimensions.
- Provide written justifications with specific evidence for each evaluation.
Qualifications
Must-Have
- Master\'s degree or higher in Finance, Accounting, or a relevant professional field.
- Professional experience applying domain expertise in a practitioner or advisory capacity.
- Familiarity with industry-specific standards, regulations, or clinical guidelines.
- Strong written communication and critical reasoning skills.
Application Process (Takes 20–30 mins to complete)
- Submit your resume to begin.
- Complete the Model Response Evaluation assessment.
Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Key skills/competency
- AI Model Evaluation
- Finance Expertise
- Regulatory Compliance
- Critical Reasoning
- Written Communication
- Prompt Engineering
- Domain Specificity
- Factual Accuracy
- Practical Usefulness
- Structured Rubrics
Skills & topics
- AI Model Evaluator
- Finance
- AI
- Machine Learning
- Data Analysis
- Evaluation
- Contract
- Remote
- Part-time
- Master's Degree
How to get hired
- Tailor your resume: Highlight finance expertise, regulatory knowledge, and critical reasoning skills.
- Prepare for assessments: Practice evaluating model responses and understanding industry standards.
- Demonstrate domain knowledge: Showcase your professional experience in finance or accounting.
- Communicate clearly: Emphasize strong written communication for justifications and feedback.
- Apply promptly: Submit your resume and complete the AI interview steps quickly.
Technical preparation
Master finance and accounting principles thoroughly.,Understand financial regulations and industry standards.,Practice critical reasoning and analytical skills.,Develop strong written communication for feedback.
Behavioral questions
How do you ensure accuracy in complex data?,Describe a time you identified misinformation.,How do you handle subjective evaluation criteria?,How do you provide constructive feedback?
Frequently asked questions
- What is the application process for the AI Model Evaluator Finance role at Mercor?
- The application process for the AI Model Evaluator Finance position at Mercor involves submitting your resume, followed by completing a Model Response Evaluation assessment. This typically takes 20-30 minutes. Our team reviews applications daily, so completing these steps promptly is crucial for consideration.
- What specific finance qualifications are required for the AI Model Evaluator role at Mercor?
- For the AI Model Evaluator role at Mercor, a Master's degree or higher in Finance, Accounting, or a related professional field is required. You'll also need professional experience applying your domain expertise in a practical or advisory capacity, along with familiarity with industry-specific standards and regulations.
- Is the AI Model Evaluator Finance position a full-time or part-time role at Mercor?
- The AI Model Evaluator Finance position at Mercor is a part-time contract role, requiring a commitment of approximately 20 hours per week.
- What are the key responsibilities of an AI Model Evaluator at Mercor?
- As an AI Model Evaluator at Mercor, you will write realistic prompts, evaluate AI-generated responses for accuracy and usefulness, identify fabricated claims or misleading reasoning, and provide written justifications with specific evidence based on structured rubrics.
- Who are Mercor's notable investors, and what does this mean for the AI Model Evaluator role?
- Mercor has strong backing from prominent investors including Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. This indicates a well-funded and ambitious venture, potentially offering interesting challenges and opportunities within the AI research space for the AI Model Evaluator.
- What is the hourly compensation for the AI Model Evaluator Finance role at Mercor?
- The AI Model Evaluator Finance role at Mercor offers an hourly compensation ranging from $50 to $75.
- How can I get help or support during the application process for Mercor's AI Model Evaluator role?
- If you need any help or support during the application process for the AI Model Evaluator role at Mercor, you can reach out to their support team via email at support@mercor.com. For interview process and platform details, please visit https://talent.docs.mercor.com/welcome/welcome.