Software Engineer, AI Research Annotation
Keystone Recruitment
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Software Engineer, AI Research Annotation
Join leading AI labs by applying software engineering expertise to improve model reasoning. Review real-world coding tasks and document problem-solving processes.
This role is for an hourly Independent Contractor, working globally remote with flexible hours of 15-25/week, up to 40.
About the Project
Support the development of advanced AI coding capabilities through structured dataset creation. Work with authentic software engineering scenarios from open-source repositories to capture realistic developer thought processes.
Detailed Responsibilities
- Review AI-generated code trajectories on SWE-bench style tasks
- Reconstruct step-by-step reasoning explaining solution approaches
- Annotate decision points, debugging strategies, and technical choices
- Use full codebase context (issues, tests, PRs) for accurate documentation
- Ensure annotations reflect authentic software engineering practices
Technical Requirements
- 2+ years hands-on software development experience
- Strong proficiency in Python, JavaScript/TypeScript, or similar languages
- Experience debugging complex codebases and resolving issues
- Familiarity with Git workflows, pull requests, and issue tracking
- Ability to articulate technical reasoning clearly in writing
Project Structure
- Duration: 1-2 months with extension opportunities
- Start: Immediate onboarding
- Onboarding: Resume review + 15-minute AI technical interview
- Pace: Self-scheduled within weekly commitment minimum
- Payment: Weekly via Stripe/Wise
Ideal Background
- Computer Science/Software Engineering degree (Bachelor's+)
- Experience with open-source contributions or repository analysis
- Understanding of software development lifecycles and testing
- Comfort working with technical documentation and specifications
Success Profile
Top performers receive rate increases and priority for future AI research projects. Join a cohort of experienced engineers shaping next-generation coding AI.
Apply Now
Upload your resume and complete a brief technical screening. All qualified software engineers are welcome regardless of background.
Key skills/competency
- Software Engineering
- AI Research
- Python
- JavaScript
- TypeScript
- Debugging
- Git
- Code Annotation
- Problem Solving
- Large Language Models
How to Get Hired at Keystone Recruitment
- Tailor your resume: Highlight extensive experience in Python, JavaScript/TypeScript, debugging, and Git workflows to impress Keystone Recruitment.
- Showcase AI capabilities: Emphasize any relevant projects or interest in AI research, large language models, or machine learning applications.
- Demonstrate problem-solving: Prepare to discuss complex coding challenges, your debugging strategies, and how you articulate technical reasoning.
- Master technical communication: Practice clearly explaining technical choices and documentation processes, crucial for this annotation role.
- Understand contractor expectations: Show your readiness for a global remote, independent contractor work arrangement and self-scheduled pace.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background