AI Red Team Specialist
Mercor
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
About Mercor
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: AI Red Team Specialist
We are seeking an AI Red Team Specialist to evaluate AI models and enhance their safety. This role involves probing with adversarial inputs to surface vulnerabilities and generating high-quality human data through annotation and classification. You will apply structured frameworks, document findings, and collaborate on sensitive topics with comprehensive support.
Role Responsibilities
- Evaluate AI models by probing with adversarial inputs to surface vulnerabilities and enhance safety.
- Generate high-quality human data by annotating failures and classifying vulnerabilities.
- Apply structured frameworks and benchmarks to maintain consistent testing.
- Document findings reproducibly to produce actionable reports and datasets for customers.
- Collaborate on sensitive topics with clear guidelines and wellness resources.
Qualifications
Must-Have
- Fluent in English and Hebrew.
- Prior experience in AI adversarial work, cybersecurity, or socio-technical probing.
- Strong communication skills to explain risks to both technical and non-technical stakeholders.
Preferred
- Experience with Adversarial ML, Cybersecurity, or Socio-technical risk.
- Skills in Creative probing such as psychology or unconventional adversarial thinking.
Compensation & Legal
This is an hourly contractor position, paid weekly via Stripe Connect, offering a compensation of $58/hour. A commitment of 20+ hours/week is required.
Application Process
The application process takes approximately 20-30 minutes and includes uploading your resume, an AI interview, and submitting a form. Applications are reviewed daily.
Resources & Support
For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome. For any help or support, reach out to: support@mercor.com.
Key skills/competency
- AI Adversarial Testing
- Cybersecurity Vulnerability
- Machine Learning Safety
- Data Annotation
- Risk Communication
- Adversarial Machine Learning
- Structured Testing Frameworks
- Technical Reporting
- Socio-technical Probing
- AI Ethics
How to Get Hired at Mercor
- Research Mercor's mission: Study their focus on connecting talent with AI research labs and their investor backing.
- Tailor your resume: Customize your resume to highlight experience in AI adversarial work, cybersecurity, and data annotation.
- Showcase communication skills: Prepare examples demonstrating your ability to explain complex technical risks clearly.
- Master the AI interview: Practice answering behavioral and technical questions concisely, as an AI will conduct the interview.
- Highlight language fluency: Emphasize your English and Hebrew fluency, a key requirement for this Mercor role.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background