English Writing Specialist

English Writing Specialist (Remote) at Keystone Recruitment

As an English Writing Specialist, you will be joining one of Keystone Recruitment's clients, who collaborates with leading AI research teams. The primary goal is to enhance the quality, reliability, and usefulness of large language models (LLMs). These advanced AI systems are integrated into various everyday and professional contexts, making accurate, clear, and well-reasoned responses absolutely critical.

Role Overview

This position is centered on evaluating and refining the general conversational behavior of AI. Your responsibilities will include reviewing responses generated by AI models, providing expert human feedback, and ensuring that the AI outputs consistently meet high standards for correctness, appropriate tone, and overall usefulness.

Key Responsibilities

• Evaluate AI-generated responses to user questions.
• Perform fact-checking using trusted public sources and tools.
• Annotate response strengths, weaknesses, and factual inaccuracies.
• Assess reasoning quality, clarity, tone, and completeness.
• Ensure outputs follow conversational and safety guidelines.
• Apply structured evaluation rubrics and benchmarks.

Required Qualifications

• Bachelor’s degree.
• Native-level or fluent English proficiency.
• Experience using large language models (LLMs).
• Excellent written communication and analytical skills.
• High attention to detail.
• Comfortable working across a wide range of topics.
• Background in structured or analytical fields (e.g., research, policy, analytics, linguistics, engineering).
• Strong college-level mathematics skills.

Nice to Have

• Experience with RLHF, model evaluation, or data annotation.
• Editing, writing, or content review experience.
• Ability to compare multiple outputs and make fine-grained quality judgments.
• Familiarity with evaluation frameworks and scoring rubrics.

What Success Looks Like

• You adeptly detect factual mistakes, reasoning gaps, and communication flaws in AI outputs.
• Your precise feedback significantly improves the accuracy and clarity of AI responses.
• You consistently produce reproducible evaluation results.
• Through your dedicated work, AI systems become demonstrably more reliable.

Why Join

One of Keystone Recruitment's clients is at the forefront of building next-generation human-in-the-loop AI systems utilized globally. This flexible, remote English Writing Specialist role offers a unique opportunity to directly influence how AI effectively communicates with users in English.

Contract & Payment Terms

• Independent contractor engagement.
• Fully remote with flexible scheduling.
• Weekly payments facilitated via Stripe or Wise.
• Projects may be extended or concluded based on performance and business needs.
• No access to confidential or proprietary employer data.
• H1-B and STEM OPT not supported.

Key skills/competency

• AI Evaluation
• Large Language Models (LLMs)
• Content Writing
• Fact-Checking
• English Grammar
• Analytical Skills
• Critical Thinking
• Data Annotation
• Linguistics
• Communication Skills