16 hours ago
Software Engineer - AI Research Annotation
Keystone Recruitment
Remote
Contractor
$75,000
Remote
Job Overview
Job TitleSoftware Engineer - AI Research Annotation
Job TypeContractor
CategoryCommerce
Experience5 Years
DegreeMaster
Offered Salary$75,000
LocationRemote
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Software Engineer - AI Research Annotation
Join leading AI labs by applying software engineering expertise to improve model reasoning. Review real-world coding tasks and document problem-solving processes.
About the Project
Support development of advanced AI coding capabilities through structured dataset creation. Work with authentic software engineering scenarios from open-source repositories to capture realistic developer thought processes.
Detailed Responsibilities
- Review AI-generated code trajectories on SWE-bench style tasks
- Reconstruct step-by-step reasoning explaining solution approaches
- Annotate decision points, debugging strategies, and technical choices
- Use full codebase context (issues, tests, PRs) for accurate documentation
- Ensure annotations reflect authentic software engineering practices
Technical Requirements
- 2+ years hands-on software development experience
- Strong proficiency in Python, JavaScript/TypeScript, or similar languages
- Experience debugging complex codebases and resolving issues
- Familiarity with Git workflows, pull requests, and issue tracking
- Ability to articulate technical reasoning clearly in writing
Project Structure
- Duration: 1-2 months with extension opportunities
- Start: Immediate onboarding
- Onboarding: Resume review + 15-minute AI technical interview
- Pace: Self-scheduled within weekly commitment minimum
- Payment: Weekly via Stripe/Wise
Ideal Background
- Computer Science/Software Engineering degree (Bachelor's+)
- Experience with open-source contributions or repository analysis
- Understanding of software development lifecycles and testing
- Comfort working with technical documentation and specifications
Success Profile
Top performers receive rate increases and priority for future AI research projects. Join cohort of experienced engineers shaping next-generation coding AI.
Key skills/competency
- AI Research
- Software Development
- Code Annotation
- Debugging
- Python
- JavaScript
- TypeScript
- Git Workflows
- Technical Documentation
- Problem-Solving
How to Get Hired at Keystone Recruitment
- Research Keystone Recruitment's culture: Study their mission, values, recent news, and employee testimonials on LinkedIn and Glassdoor.
- Tailor your resume: Highlight software development, AI, Python/JavaScript, and Git experience. Showcase open-source contributions.
- Prepare for technical screening: Brush up on debugging complex code, articulating technical reasoning, and real-world coding scenarios.
- Showcase problem-solving skills: Emphasize how you approach and document solutions to coding challenges for AI.
- Articulate your interest in AI: Connect your engineering background to the project's goal of improving AI coding capabilities.
Frequently Asked Questions
Find answers to common questions about this job opportunity
01What is the scope of the Software Engineer - AI Research Annotation role at Keystone Recruitment?
02What programming languages are essential for this AI Research Annotation position?
03How is the 'Global Remote' work arrangement structured for this Keystone Recruitment project?
04What type of interview process can I expect for the Software Engineer - AI Research Annotation role?
05What are the key responsibilities for annotating AI-generated code trajectories?
06How does Keystone Recruitment support professional growth for this contractor role?
07What kind of prior experience is considered ideal for this AI Research Annotation opportunity?
08How are payments handled for independent contractors on this project?
09Can you provide more detail on the duration and potential extensions for this project?
10What defines success for a Software Engineer - AI Research Annotation at Keystone Recruitment?
Explore similar opportunities that match your background