11 days ago

Software Engineer, AI Research Annotation

Keystone Recruitment

Remote
Contractor
$120,000
Remote

Job Overview

Job TitleSoftware Engineer, AI Research Annotation
Job TypeContractor
CategoryCommerce
Experience5 Years
DegreeMaster
Offered Salary$120,000
LocationRemote

Who's the hiring manager?

Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Uncover Hiring Manager

Job Description

Software Engineer, AI Research Annotation at Keystone Recruitment

Join leading AI labs by applying software engineering expertise to improve model reasoning. Review real-world coding tasks and document problem-solving processes.

About the Project

Support development of advanced AI coding capabilities through structured dataset creation. Work with authentic software engineering scenarios from open-source repositories to capture realistic developer thought processes.

Detailed Responsibilities

  • Review AI-generated code trajectories on SWE-bench style tasks
  • Reconstruct step-by-step reasoning explaining solution approaches
  • Annotate decision points, debugging strategies, and technical choices
  • Use full codebase context (issues, tests, PRs) for accurate documentation
  • Ensure annotations reflect authentic software engineering practices

Technical Requirements

  • 2+ years hands-on software development experience
  • Strong proficiency in Python, JavaScript/TypeScript, or similar languages
  • Experience debugging complex codebases and resolving issues
  • Familiarity with Git workflows, pull requests, and issue tracking
  • Ability to articulate technical reasoning clearly in writing

Project Structure

  • Duration: 1-2 months with extension opportunities
  • Start: Immediate onboarding
  • Onboarding: Resume review + 15-minute AI technical interview
  • Pace: Self-scheduled within weekly commitment minimum
  • Payment: Weekly via Stripe/Wise

Ideal Background

  • Computer Science/Software Engineering degree (Bachelor's+)
  • Experience with open-source contributions or repository analysis
  • Understanding of software development lifecycles and testing
  • Comfort working with technical documentation and specifications

Success Profile

Top performers receive rate increases and priority for future AI research projects. Join cohort of experienced engineers shaping next-generation coding AI.

Key skills/competency

  • AI Model Reasoning
  • Code Annotation
  • Software Development
  • Python/JavaScript
  • Debugging
  • Git Workflows
  • Technical Documentation
  • Problem-Solving
  • Open-Source Contribution
  • Data Curation

Tags:

Software engineer
AI research
Annotation
Machine learning
Developer
Programmer
Code review
Debugging
Problem-solving
Technical writing
Data annotation
Git workflow
Software development lifecycle
Open-source
Reasoning
AI development
Python
JavaScript
TypeScript
Git
SWE-bench
Open-source repositories
Code analysis
Debuggers
Issue tracking
PR reviews

Share Job:

How to Get Hired at Keystone Recruitment

  • Research Keystone Recruitment's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor.
  • Customize your resume for AI annotation: Highlight software engineering experience, debugging, Python/JavaScript, and Git skills relevant to AI research annotation tasks.
  • Showcase problem-solving and communication: Prepare to discuss how you've debugged complex code and articulated technical reasoning clearly in previous roles.
  • Ace the technical interview: Be ready for a 15-minute AI technical interview demonstrating practical coding knowledge and problem-solving abilities.
  • Emphasize independent work and flexibility: As an independent contractor, demonstrate your ability to manage self-scheduled tasks and commit to weekly hours efficiently.

Frequently Asked Questions

Find answers to common questions about this job opportunity

Explore similar opportunities that match your background