English and Arabic Writing Specialist

Role Overview

One of our clients, a leading AI research organization, is developing advanced conversational AI systems used across a wide range of real-world applications. This English and Arabic Writing Specialist role focuses on evaluating and improving how these systems communicate in both English and Arabic, ensuring responses are accurate, well-reasoned, culturally appropriate, and aligned with human expectations.

Key Responsibilities

• Evaluate AI-generated responses for accuracy, clarity, tone, and completeness
• Verify factual claims using trusted public sources and external tools
• Annotate responses by identifying strengths, weaknesses, and factual or logical errors
• Assess reasoning quality and communication effectiveness across diverse topics
• Ensure outputs follow defined conversational and quality guidelines
• Apply standardized taxonomies, benchmarks, and evaluation frameworks consistently

Required Qualifications

• Bachelor’s degree or equivalent professional experience
• Professional-level fluency in Arabic and English, with the ability to read, write, and evaluate nuanced content
• Strong familiarity with large language models and how they are used
• Excellent written communication and analytical skills
• High attention to detail and ability to detect subtle errors or inconsistencies
• Comfort working across varied topics and structured evaluation workflows
• Background or experience in fields that require analytical or structured thinking

Preferred Qualifications

• Experience with RLHF, AI evaluation, or data annotation
• Experience writing, editing, or reviewing high-quality content
• Ability to compare multiple outputs and make fine-grained qualitative judgments
• Familiarity with evaluation rubrics, benchmarks, or quality scoring systems

What Success Looks Like

• You consistently identify factual errors, weak reasoning, or communication gaps
• Your feedback improves the accuracy, clarity, and usefulness of AI-generated responses
• You deliver clear, consistent, and reproducible evaluation data that strengthens model performance

Contract & Payment Terms

• Independent contractor engagement
• Fully remote with flexible scheduling
• Weekly payments via Stripe or Wise
• Project scope and duration may vary based on client needs and performance
• No access to confidential or proprietary employer data is required
• H1-B and STEM OPT sponsorship is not available

Application Process

• Submit your resume for review
• Selected candidates will complete a brief language and evaluation skills assessment

Key skills/competency

• AI Evaluation
• Arabic Fluency
• English Fluency
• Content Analysis
• Large Language Models
• Factual Verification
• Quality Assurance
• Analytical Thinking
• Data Annotation
• Conversational AI