10 days ago

Software Engineer, AI Research Annotation

Keystone Recruitment

Remote
Contractor
$85,000
Remote

Job Overview

Job TitleSoftware Engineer, AI Research Annotation
Job TypeContractor
CategoryCommerce
Experience5 Years
DegreeMaster
Offered Salary$85,000
LocationRemote

Who's the hiring manager?

Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Uncover Hiring Manager

Job Description

Software Engineer, AI Research Annotation at Keystone Recruitment

Join leading AI labs by applying your software engineering expertise to significantly improve AI model reasoning. In this role, you will review real-world coding tasks and meticulously document the problem-solving processes involved.

About the Project

This project supports the development of advanced AI coding capabilities through structured dataset creation. You will work with authentic software engineering scenarios drawn from open-source repositories, capturing realistic developer thought processes to enhance AI understanding.

Detailed Responsibilities

  • Review AI-generated code trajectories on SWE-bench style tasks.
  • Reconstruct step-by-step reasoning, thoroughly explaining solution approaches.
  • Annotate critical decision points, effective debugging strategies, and technical choices made during development.
  • Utilize full codebase context, including issues, tests, and pull requests, for accurate and comprehensive documentation.
  • Ensure all annotations genuinely reflect authentic software engineering practices and methodologies.

Technical Requirements

  • 2+ years of hands-on software development experience.
  • Strong proficiency in Python, JavaScript/TypeScript, or other similar programming languages.
  • Demonstrated experience in debugging complex codebases and effectively resolving intricate issues.
  • Familiarity with standard Git workflows, including pull requests and issue tracking systems.
  • Exceptional ability to articulate technical reasoning clearly and concisely in written form.

Project Structure

  • Duration: Initially 1-2 months, with strong opportunities for extension.
  • Start: Immediate onboarding available.
  • Onboarding Process: Requires resume review followed by a brief 15-minute AI technical interview.
  • Pace: Self-scheduled work within a defined weekly commitment minimum.
  • Payment: Weekly payments processed via Stripe or Wise.

Ideal Background

  • Bachelor's degree or higher in Computer Science or Software Engineering.
  • Previous experience with open-source contributions or in-depth repository analysis.
  • Solid understanding of software development lifecycles and various testing methodologies.
  • Comfort and proficiency in working with technical documentation and detailed specifications.

Success Profile

Top performers in this role will be eligible for rate increases and receive priority consideration for future AI research projects. This is an opportunity to join a cohort of experienced engineers dedicated to shaping the next generation of coding AI.

Apply Now

To apply, upload your resume and complete a brief technical screening. Keystone Recruitment welcomes all qualified software engineers, regardless of background.

Key skills/competency

  • AI Research
  • Code Annotation
  • Software Engineering
  • Debugging
  • Python
  • JavaScript
  • TypeScript
  • Git Workflows
  • Problem-Solving
  • Technical Writing
  • Open Source

Tags:

Software Engineer, AI Research Annotation
AI Research
Machine Learning
Code Annotation
Debugging
Python
JavaScript
TypeScript
Git
Software Development
Open Source
Problem Solving
Technical Writing
Data Annotation
Large Language Models
SWE-bench
Algorithm Design
Code Review
Testing
Software Architecture

Share Job:

How to Get Hired at Keystone Recruitment

  • Research Keystone Recruitment's culture: Explore their mission, values, and client focus. Look for insights on their LinkedIn profile.
  • Tailor your resume precisely: Highlight 2+ years of software development, Python/JavaScript proficiency, and debugging skills for AI research annotation roles.
  • Showcase technical writing ability: Emphasize experience documenting complex reasoning, decision points, and debugging strategies on projects.
  • Prepare for the 15-minute AI technical interview: Be ready to discuss your software engineering expertise and problem-solving approach concisely.
  • Articulate open-source contributions: If applicable, demonstrate experience with repository analysis or contributions to align with project needs.

Frequently Asked Questions

Find answers to common questions about this job opportunity

Explore similar opportunities that match your background