4 days ago
Software Engineer - AI Research Annotation
Keystone Recruitment
Hybrid
Contractor
$130,000
Hybrid
Job Overview
Job TitleSoftware Engineer - AI Research Annotation
Job TypeContractor
CategoryCommerce
Experience5 Years
DegreeMaster
Offered Salary$130,000
LocationHybrid
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Job Description
About the Project
Support the development of advanced AI coding capabilities through structured dataset creation. Work with authentic software engineering scenarios from open-source repositories to capture realistic developer thought processes.
Detailed Responsibilities
- Review AI-generated code trajectories on SWE-bench style tasks
- Reconstruct step-by-step reasoning explaining solution approaches
- Annotate decision points, debugging strategies, and technical choices
- Use full codebase context (issues, tests, PRs) for accurate documentation
- Ensure annotations reflect authentic software engineering practices
Technical Requirements
- 2+ years hands-on software development experience
- Strong proficiency in Python, JavaScript/TypeScript, or similar languages
- Experience debugging complex codebases and resolving issues
- Familiarity with Git workflows, pull requests, and issue tracking
- Ability to articulate technical reasoning clearly in writing
Project Structure
- Duration: 1-2 months with extension opportunities
- Start: Immediate onboarding
- Onboarding: Resume review + 15-minute AI technical interview
- Pace: Self-scheduled within weekly commitment minimum
- Payment: Weekly via Stripe/Wise
Ideal Background
- Computer Science/Software Engineering degree (Bachelor's+)
- Experience with open-source contributions or repository analysis
- Understanding of software development lifecycles and testing
- Comfort working with technical documentation and specifications
Success Profile
Top performers receive rate increases and priority for future AI research projects. Join a cohort of experienced engineers shaping next-generation coding AI.
Key skills/competency
- AI Research
- Software Engineering
- Code Annotation
- Debugging
- Python
- JavaScript
- Git Workflows
- Technical Documentation
- Problem Solving
- Open Source
How to Get Hired at Keystone Recruitment
- Research Keystone Recruitment's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor.
- Tailor your resume: Customize your resume to highlight software development, AI research annotation, and debugging skills. Emphasize open-source contributions.
- Showcase your AI and coding expertise: Prepare to demonstrate strong proficiency in Python, JavaScript/TypeScript, and experience with complex codebase debugging.
- Prepare for the AI technical interview: Practice articulating technical reasoning and problem-solving approaches clearly for the 15-minute AI technical interview.
- Highlight remote work aptitude: Emphasize your ability to manage self-scheduled tasks and commit to weekly deliverables in a global remote setting.
Frequently Asked Questions
Find answers to common questions about this job opportunity
01What is the typical weekly commitment for the Software Engineer - AI Research Annotation role at Keystone Recruitment?
02What programming languages are essential for this AI Research Annotation position?
03Does Keystone Recruitment offer extensions for the Software Engineer - AI Research Annotation project?
04How will my work impact AI development in this Software Engineer - AI Research Annotation role?
05What is the interview process for the AI Research Annotation role at Keystone Recruitment?
06What kind of codebases will I be working with as a Software Engineer - AI Research Annotation?
07How important is open-source experience for this Software Engineer - AI Research Annotation role?
08How often is payment processed for this independent contractor role with Keystone Recruitment?
09What specific documentation will I create as a Software Engineer - AI Research Annotator?
10Are there opportunities for advancement or future projects at Keystone Recruitment after this AI Research Annotation role?
Explore similar opportunities that match your background