Software Engineer - AI Research Annotation
Keystone Recruitment
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Software Engineer - AI Research Annotation
Join leading AI labs by applying software engineering expertise to improve model reasoning. Review real-world coding tasks and document problem-solving processes. This global remote, independent contractor role offers flexible hours, allowing you to contribute to cutting-edge AI development.
About the Project
Support the development of advanced AI coding capabilities through structured dataset creation. You will work with authentic software engineering scenarios from open-source repositories to capture realistic developer thought processes, directly influencing the next generation of coding AI.
Detailed Responsibilities
- Review AI-generated code trajectories on SWE-bench style tasks.
- Reconstruct step-by-step reasoning explaining solution approaches.
- Annotate decision points, debugging strategies, and technical choices.
- Utilize full codebase context (issues, tests, PRs) for accurate documentation.
- Ensure annotations reflect authentic software engineering practices.
Technical Requirements
- 2+ years hands-on software development experience.
- Strong proficiency in Python, JavaScript/TypeScript, or similar languages.
- Experience debugging complex codebases and resolving issues.
- Familiarity with Git workflows, pull requests, and issue tracking.
- Ability to articulate technical reasoning clearly in writing.
Project Structure
- Duration: 1-2 months with extension opportunities.
- Start: Immediate onboarding.
- Onboarding: Resume review + 15-minute AI technical interview.
- Pace: Self-scheduled within weekly commitment minimum (15-25 hours/week, flexible up to 40).
- Payment: Weekly via Stripe/Wise.
Ideal Background
- Computer Science/Software Engineering degree (Bachelor's+).
- Experience with open-source contributions or repository analysis.
- Understanding of software development lifecycles and testing.
- Comfort working with technical documentation and specifications.
Success Profile
Top performers will receive rate increases and priority for future AI research projects. This is an opportunity to join a cohort of experienced engineers shaping next-generation coding AI.
Key skills/competency
- Software Development
- Python
- JavaScript/TypeScript
- Debugging
- Git Workflows
- AI Model Reasoning
- Dataset Creation
- Problem Solving
- Technical Documentation
- Open-Source Contribution
How to Get Hired at Keystone Recruitment
- Research Keystone Recruitment's culture: Study their mission and values, particularly regarding remote contractor engagement and AI innovation.
- Tailor your resume for AI roles: Highlight experience in software development, AI-related projects, and strong technical communication for Software Engineer - AI Research Annotation positions.
- Showcase open-source contributions: Emphasize any work with open-source repositories, demonstrating practical experience with real-world codebases.
- Prepare for the AI technical interview: Brush up on debugging complex code, Git workflows, and articulating technical reasoning clearly.
- Network effectively: Connect with Keystone Recruitment professionals on LinkedIn to gain insights and express your interest in AI research opportunities.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background