Legal AI Evaluator

Legal AI Evaluator at DataAnnotation

We are looking for a Legal AI Evaluator to join our team to train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert level of legal reasoning — a completed or in-progress law degree is required.

We are interested in a wide range of expertise, so relevant backgrounds include: corporate law, criminal law, civil litigation, constitutional law, administrative law, environmental law, family law, intellectual property law, tax law, labor and employment law, immigration law, real estate law, health law, entertainment law, human rights law, international law, cybersecurity and privacy law, contract law, securities law, bankruptcy law, and alternative dispute resolution.

Benefits

• You’ll be able to choose which projects you want to work on
• You can work on your own schedule
• Projects are paid hourly starting at $50-$60 USD per hour, with bonuses on high-quality and high-volume work

Responsibilities

• Give AI chatbots diverse and complex legal problems and evaluate their outputs
• Evaluate the quality produced by AI models for correctness and performance

Qualifications

• Fluency in English (native or bilingual level)
• Must have at least 5+ years of law experience
• Must be a law school graduate

Note

Payment is made via PayPal. We will never ask for any money from you. PayPal will handle any currency conversions from USD. Only applicants in the United States will be considered for this role. This is an independent contract position.

Key skills/competency

• Legal Reasoning
• AI Model Evaluation
• Problem Solving
• Legal Analysis
• Quality Assurance
• English Fluency
• Contract Law
• Intellectual Property Law
• Independent Work
• Critical Thinking