4 days ago
Software Engineer, AI Research Annotation
Keystone Recruitment
Hybrid
Contractor
$105,000
Hybrid
Job Overview
Job TitleSoftware Engineer, AI Research Annotation
Job TypeContractor
CategoryCommerce
Experience5 Years
DegreeMaster
Offered Salary$105,000
LocationHybrid
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Software Engineer, AI Research Annotation at Keystone Recruitment
Join leading AI labs by applying software engineering expertise to improve model reasoning. Review real-world coding tasks and document problem-solving processes.
Project Overview
Support development of advanced AI coding capabilities through structured dataset creation. Work with authentic software engineering scenarios from open-source repositories to capture realistic developer thought processes.
Key Responsibilities
- Review AI-generated code trajectories on SWE-bench style tasks
- Reconstruct step-by-step reasoning explaining solution approaches
- Annotate decision points, debugging strategies, and technical choices
- Use full codebase context (issues, tests, PRs) for accurate documentation
- Ensure annotations reflect authentic software engineering practices
Technical Expertise Required
- 2+ years hands-on software development experience
- Strong proficiency in Python, JavaScript/TypeScript, or similar languages
- Experience debugging complex codebases and resolving issues
- Familiarity with Git workflows, pull requests, and issue tracking
- Ability to articulate technical reasoning clearly in writing
Project Structure & Logistics
- Duration: 1-2 months with extension opportunities
- Start: Immediate onboarding
- Onboarding: Resume review + 15-minute AI technical interview
- Pace: Self-scheduled within weekly commitment minimum
- Payment: Weekly via Stripe/Wise
Ideal Candidate Profile
- Computer Science/Software Engineering degree (Bachelor's+)
- Experience with open-source contributions or repository analysis
- Understanding of software development lifecycles and testing
- Comfort working with technical documentation and specifications
Success & Growth Opportunities
Top performers receive rate increases and priority for future AI research projects. Join cohort of experienced engineers shaping next-generation coding AI.
Key skills/competency
- AI Research
- Software Engineering
- Code Annotation
- Debugging
- Python
- JavaScript
- Git Workflows
- Technical Documentation
- Problem Solving
- Open Source
How to Get Hired at Keystone Recruitment
- Research Keystone Recruitment's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor.
- Tailor your resume: Highlight your experience in AI, software development, debugging, and code annotation.
- Prepare for the AI technical interview: Focus on demonstrating strong coding, debugging, and Git workflow knowledge.
- Showcase your problem-solving skills: Be ready to articulate your reasoning for complex coding challenges and technical choices.
- Emphasize remote collaboration: Highlight your ability to manage self-scheduled tasks and thrive in a global remote environment.
Frequently Asked Questions
Find answers to common questions about this job opportunity
01What does a Software Engineer, AI Research Annotation do at Keystone Recruitment?
02What are the key technical skills required for this AI Research Annotation role?
03How is the work structured for this global remote position at Keystone Recruitment?
04What is the typical duration of an AI Research Annotation project with Keystone Recruitment?
05What growth opportunities are available for top performers at Keystone Recruitment?
06How does Keystone Recruitment conduct the technical interview for this role?
07Is a Computer Science degree mandatory for the Software Engineer, AI Research Annotation role?
08How are payments handled for independent contractors at Keystone Recruitment?
09Can I adjust my weekly hours for the AI Research Annotation project?
10What kind of codebases will I be reviewing in this Software Engineer, AI Research Annotation role?
Explore similar opportunities that match your background