7 days ago

Software Engineer - AI Research Annotation

Keystone Recruitment

Hybrid
Contractor
$90,000
Hybrid

Job Overview

Job TitleSoftware Engineer - AI Research Annotation
Job TypeContractor
CategoryCommerce
Experience5 Years
DegreeMaster
Offered Salary$90,000
LocationHybrid

Who's the hiring manager?

Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Uncover Hiring Manager

Job Description

About the Software Engineer - AI Research Annotation Role

Join leading AI labs as a Software Engineer - AI Research Annotation, applying your software engineering expertise to significantly improve AI model reasoning. This role involves reviewing real-world coding tasks and meticulously documenting problem-solving processes to support the development of advanced AI coding capabilities.

You will contribute to structured dataset creation by working with authentic software engineering scenarios drawn from open-source repositories, capturing realistic developer thought processes.

Detailed Responsibilities

  • Review AI-generated code trajectories on SWE-bench style tasks.
  • Reconstruct step-by-step reasoning, explaining solution approaches.
  • Annotate decision points, debugging strategies, and technical choices.
  • Utilize full codebase context (issues, tests, PRs) for accurate documentation.
  • Ensure annotations reflect authentic software engineering practices.

Technical Requirements

  • 2+ years of hands-on software development experience.
  • Strong proficiency in Python, JavaScript/TypeScript, or similar languages.
  • Experience debugging complex codebases and resolving issues.
  • Familiarity with Git workflows, pull requests, and issue tracking.
  • Ability to articulate technical reasoning clearly in writing.

Project Structure

This project has a duration of 1-2 months with potential extension opportunities, offering immediate onboarding. The pace is self-scheduled within a weekly commitment minimum of 15-25 hours (flexible up to 40 hours). Payment is processed weekly via Stripe/Wise.

Ideal Background

  • Computer Science/Software Engineering degree (Bachelor's+).
  • Experience with open-source contributions or repository analysis.
  • Understanding of software development lifecycles and testing.
  • Comfort working with technical documentation and specifications.

Success Profile

Top performers in the Software Engineer - AI Research Annotation role receive rate increases and priority for future AI research projects. You will join a cohort of experienced engineers dedicated to shaping the next generation of coding AI.

Key skills/competency

  • Software Engineering
  • AI Research
  • Code Annotation
  • Python
  • JavaScript/TypeScript
  • Debugging
  • Git Workflows
  • Technical Documentation
  • Problem Solving
  • Data Annotation

Tags:

Software Engineer
AI Research
Annotation
Python
JavaScript
TypeScript
Debugging
Git
Open-source
SWE-bench
Data Annotation
Machine Learning
AI Development
Code Analysis
Technical Writing
Software Development Lifecycle
Issue Tracking
Pull Requests
Algorithms
Data Structures

Share Job:

How to Get Hired at Keystone Recruitment

  • Research Keystone Recruitment's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor.
  • Tailor your resume for AI roles: Highlight software development experience, AI/ML exposure, and annotation or data labeling projects.
  • Showcase technical writing skills: Prepare examples demonstrating your ability to articulate complex technical reasoning clearly and concisely.
  • Master core programming concepts: Brush up on Python, JavaScript, debugging, and Git workflows, as these are critical for the technical interview.
  • Demonstrate open-source contributions: Mention any experience with open-source projects, repository analysis, or structured data creation.

Frequently Asked Questions

Find answers to common questions about this job opportunity

Explore similar opportunities that match your background