Software Engineer - AI Research Annotation
Keystone Recruitment
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
About the Role: Software Engineer - AI Research Annotation
Join leading AI labs as a Software Engineer specializing in AI Research Annotation, applying your expertise to significantly improve model reasoning. In this global remote contract role, you will review real-world coding tasks and meticulously document problem-solving processes, playing a crucial part in the development of advanced AI coding capabilities.
You will support advanced AI coding capabilities through structured dataset creation, working with authentic software engineering scenarios from open-source repositories to capture realistic developer thought processes. This role offers flexible hours, ranging from 15-25 weeks, with potential for up to 40, and an immediate start with opportunities for extension.
Detailed Responsibilities
- Review AI-generated code trajectories on SWE-bench style tasks.
- Reconstruct step-by-step reasoning, explaining solution approaches.
- Annotate decision points, debugging strategies, and technical choices.
- Utilize full codebase context (issues, tests, PRs) for accurate documentation.
- Ensure annotations reflect authentic software engineering practices.
Technical Requirements
- 2+ years of hands-on software development experience.
- Strong proficiency in Python, JavaScript/TypeScript, or similar languages.
- Experience debugging complex codebases and resolving issues.
- Familiarity with Git workflows, pull requests, and issue tracking.
- Ability to articulate technical reasoning clearly in writing.
Project Structure
- Duration: 1-2 months with extension opportunities.
- Start: Immediate onboarding.
- Onboarding: Resume review + 15-minute AI technical interview.
- Pace: Self-scheduled within weekly commitment minimum.
- Payment: Weekly via Stripe/Wise.
Ideal Background
- Computer Science/Software Engineering degree (Bachelor's+).
- Experience with open-source contributions or repository analysis.
- Understanding of software development lifecycles and testing.
- Comfort working with technical documentation and specifications.
Success Profile
Top performers will receive rate increases and priority for future AI research projects. Join a cohort of experienced engineers shaping next-generation coding AI.
Key skills/competency
- Python
- JavaScript
- TypeScript
- Debugging
- Git Workflows
- Code Annotation
- AI Model Reasoning
- Open-Source Contribution
- Software Development
- Technical Documentation
How to Get Hired at Keystone Recruitment
- Research Keystone Recruitment's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor, focusing on their work with leading AI labs.
- Tailor your resume for AI roles: Customize your resume to highlight experience in software development, AI research, code annotation, and debugging complex systems.
- Showcase relevant technical skills: Emphasize strong proficiency in Python, JavaScript/TypeScript, Git workflows, and experience with open-source contributions.
- Prepare for the AI technical interview: Be ready for a focused 15-minute technical screening, demonstrating your ability to articulate technical reasoning and debug code effectively.
- Demonstrate problem-solving and documentation: Practice explaining your step-by-step reasoning for coding solutions and your approach to documenting technical choices.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background