9 days ago

Software Engineer - AI Research Annotation

Keystone Recruitment

Hybrid
Contractor
$110,000
Hybrid

Job Overview

Job TitleSoftware Engineer - AI Research Annotation
Job TypeContractor
CategoryCommerce
Experience5 Years
DegreeMaster
Offered Salary$110,000
LocationHybrid

Who's the hiring manager?

Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Uncover Hiring Manager

Job Description

Software Engineer - AI Research Annotation

Join leading AI labs by applying your software engineering expertise to improve model reasoning. In this role, you will review real-world coding tasks and meticulously document problem-solving processes.

About the Project

This project supports the development of advanced AI coding capabilities through structured dataset creation. You will work with authentic software engineering scenarios derived from open-source repositories to capture realistic developer thought processes.

Detailed Responsibilities

  • Review AI-generated code trajectories on SWE-bench style tasks.
  • Reconstruct step-by-step reasoning, explaining solution approaches.
  • Annotate decision points, debugging strategies, and technical choices.
  • Utilize full codebase context (issues, tests, PRs) for accurate documentation.
  • Ensure annotations reflect authentic software engineering practices.

Technical Requirements

  • 2+ years hands-on software development experience.
  • Strong proficiency in Python, JavaScript/TypeScript, or similar languages.
  • Experience debugging complex codebases and resolving issues.
  • Familiarity with Git workflows, pull requests, and issue tracking.
  • Ability to articulate technical reasoning clearly in writing.

Project Structure

  • Duration: 1-2 months with extension opportunities.
  • Start: Immediate onboarding.
  • Onboarding: Resume review + 15-minute AI technical interview.
  • Pace: Self-scheduled within weekly commitment minimum (15-25 hours/week, flexible up to 40).
  • Payment: Weekly via Stripe/Wise.

Ideal Background

  • Computer Science/Software Engineering degree (Bachelor's+).
  • Experience with open-source contributions or repository analysis.
  • Understanding of software development lifecycles and testing.
  • Comfort working with technical documentation and specifications.

Success Profile

Top performers in this Software Engineer - AI Research Annotation role receive rate increases and priority for future AI research projects. You will join a cohort of experienced engineers shaping next-generation coding AI.

Key skills/competency

  • Software Engineering
  • AI Research
  • Code Annotation
  • Python
  • JavaScript/TypeScript
  • Debugging
  • Git Workflows
  • Technical Writing
  • Problem Solving
  • Open Source

Tags:

Software Engineer
AI Research
Annotation
Code Review
Debugging
Problem Solving
Technical Documentation
Dataset Creation
AI Models
Software Development
Python
JavaScript
TypeScript
Git
Open Source
SWE-bench
Machine Learning

Share Job:

How to Get Hired at Keystone Recruitment

  • Research Keystone Recruitment's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor.
  • Tailor your resume: Highlight Python, JavaScript/TypeScript, debugging, and Git experience relevant to AI annotation tasks.
  • Prepare for the technical interview: Practice problem-solving, code review, and clearly articulating technical decisions and reasoning.
  • Showcase your AI and open-source interest: Emphasize any experience with AI models, data annotation, or contributions to open-source projects.
  • Demonstrate clear communication: Be ready to explain complex technical reasoning and document problem-solving processes effectively.

Frequently Asked Questions

Find answers to common questions about this job opportunity

Explore similar opportunities that match your background