Data Annotation Specialist - AI Lab
Mercor · New York, NY
This listing has closed — view similar roles below.
- Hybrid
- Part-time
- $104,000 / year
- New York, NY
Job highlights
- Annotate AI outputs with high accuracy.
- Follow complex guidelines precisely.
- Provide feedback to improve AI quality.
- Requires exceptional attention to detail.
- Work independently on repetitive tasks.
About the role
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Generalist
Type: Contract
Compensation: $50/hour
Location: Remote
Role Responsibilities
- Review, evaluate, and annotate AI outputs with extreme attention to detail.
- Follow complex guidelines precisely and apply them consistently across tasks.
- Identify subtle errors, edge cases, and quality issues others might miss.
- Provide clear, structured feedback to improve downstream AI training quality.
- Maintain high accuracy across repetitive, high-volume workflows.
- Flag unclear instructions or ambiguous cases proactively.
Qualifications
Must-Have
- Exceptionally detail-oriented and quality-obsessed mindset.
- Prior experience as a CB / reviewer / rater in human data or AI training pipelines.
- Proven ability to follow nuanced instructions without deviation.
- Strong written communication and reasoning skills.
- High reliability, consistency, and comfort with repetitive precision work.
- Ability to work independently and maintain focus over long task batches.
Preferred
- Experience with large-scale AI data annotation or evaluation programs.
- Background in QA, operations, trust & safety, or structured review work.
- Familiarity with multi-step rubric-based evaluations.
- Comfort giving calibrated feedback aligned with strict quality bars.
Key skills/competency
- Data Annotation
- AI Training
- Quality Assurance
- Attention to Detail
- Feedback Provision
- Workflow Management
- Independent Work
- Problem Solving
- Communication
- Reliability
Skills & topics
- Data Annotation Specialist
- AI
- Machine Learning
- Data Labeling
- Quality Assurance
- Remote
- Contract
- Data Review
- Annotation
- AI Training
How to get hired
- Tailor your resume: Highlight your experience in data annotation, quality assurance, and following detailed instructions.
- Complete the application: Submit your resume and meticulously fill out all required information.
- Ace the AI interview: Be prepared for an AI-driven interview that assesses your resume and skills.
- Review resources: Familiarize yourself with the interview process and platform details at talent.docs.mercor.com.
- Reach out for support: Contact support@mercor.com for any questions or assistance.
Technical preparation
Practice following complex, multi-step instructions.,Familiarize yourself with data annotation tools.,Review AI basics and machine learning concepts.,Develop speed and accuracy in repetitive tasks.
Behavioral questions
Describe a time you followed complex instructions.,How do you ensure accuracy in repetitive tasks?,How do you handle ambiguous instructions?,What motivates you to maintain high quality?
Frequently asked questions
- What is the application process for a Data Annotation Specialist at Mercor?
- The application process for a Data Annotation Specialist at Mercor involves uploading your resume, completing an AI interview based on your resume, and submitting the form. It typically takes 20-30 minutes.
- How does Mercor use AI interviews for the Data Annotation Specialist role?
- Mercor uses AI interviews to assess candidates for the Data Annotation Specialist position. The AI will analyze your resume and likely ask questions to gauge your suitability for the role, focusing on your attention to detail and ability to follow instructions.
- What kind of experience is preferred for the Data Annotation Specialist role at Mercor?
- Mercor prefers candidates with experience in large-scale AI data annotation or evaluation programs, as well as backgrounds in QA, operations, trust & safety, or structured review work. Familiarity with multi-step rubric-based evaluations and calibrated feedback is also a plus.
- Is the Data Annotation Specialist position at Mercor remote?
- Yes, the Data Annotation Specialist position at Mercor is a remote role, allowing you to work from any location.
- What is the compensation for a Data Annotation Specialist at Mercor?
- The Data Annotation Specialist role at Mercor offers an hourly compensation of $50, with payments made weekly via Stripe Connect.
- How can I get help or support during the application process for the Data Annotation Specialist role?
- If you need any help or support during the application process for the Data Annotation Specialist role, you can reach out to Mercor's support team at support@mercor.com.
- What are the key skills required for a Data Annotation Specialist at Mercor?
- Key skills for a Data Annotation Specialist at Mercor include exceptional attention to detail, the ability to follow complex instructions precisely, strong written communication, high reliability, and comfort with repetitive, high-volume work.
- Who are Mercor's investors, and what does this mean for the Data Annotation Specialist role?
- Mercor is backed by notable investors such as Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey. This strong backing suggests a stable and growing company, offering a potentially secure environment for contract roles like the Data Annotation Specialist.