3 days ago
Software Engineer - AI Research Annotation
Keystone Recruitment
Remote
Contractor
$95,000
Remote
Job Overview
Job TitleSoftware Engineer - AI Research Annotation
Job TypeContractor
CategoryCommerce
Experience5 Years
DegreeMaster
Offered Salary$95,000
LocationRemote
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Software Engineer - AI Research Annotation
Join leading AI labs by applying software engineering expertise to improve model reasoning. Review real-world coding tasks and document problem-solving processes.
About the Project
Support development of advanced AI coding capabilities through structured dataset creation. Work with authentic software engineering scenarios from open-source repositories to capture realistic developer thought processes.Detailed Responsibilities
- Review AI-generated code trajectories on SWE-bench style tasks
- Reconstruct step-by-step reasoning explaining solution approaches
- Annotate decision points, debugging strategies, and technical choices
- Use full codebase context (issues, tests, PRs) for accurate documentation
- Ensure annotations reflect authentic software engineering practices
Technical Requirements
- 2+ years hands-on software development experience
- Strong proficiency in Python, JavaScript/TypeScript, or similar languages
- Experience debugging complex codebases and resolving issues
- Familiarity with Git workflows, pull requests, and issue tracking
- Ability to articulate technical reasoning clearly in writing
Project Structure
- Duration: 1-2 months with extension opportunities
- Start: Immediate onboarding
- Onboarding: Resume review + 15-minute AI technical interview
- Pace: Self-scheduled within weekly commitment minimum
- Payment: Weekly via Stripe/Wise
Ideal Background
- Computer Science/Software Engineering degree (Bachelor's+)
- Experience with open-source contributions or repository analysis
- Understanding of software development lifecycles and testing
- Comfort working with technical documentation and specifications
Success Profile
Top performers receive rate increases and priority for future AI research projects. Join a cohort of experienced engineers shaping next-generation coding AI.Key skills/competency
- AI Research
- Software Engineering
- Python
- JavaScript/TypeScript
- Debugging
- Git Workflows
- Code Annotation
- Problem Solving
- Open Source
- Technical Documentation
How to Get Hired at Keystone Recruitment
- Research Keystone Recruitment's mission: Understand their focus on AI and contractor roles to align your application.
- Tailor your resume: Highlight 2+ years of software development, AI, Python/JavaScript, and debugging experience.
- Showcase open-source contributions: Emphasize any experience with GitHub, pull requests, and code annotation.
- Prepare for the AI technical interview: Be ready to discuss code trajectories, reasoning, and debugging strategies.
- Articulate technical reasoning clearly: Practice explaining complex technical choices and problem-solving approaches concisely.
Frequently Asked Questions
Find answers to common questions about this job opportunity
01What is the primary focus of the Software Engineer - AI Research Annotation role at Keystone Recruitment?
02What technical skills are essential for this AI Research Annotation position?
03Is the Software Engineer - AI Research Annotation role a full-time position?
04What does the onboarding process for the AI Research Annotation project involve?
05What kind of tasks will a Software Engineer perform in this annotation role?
06How long is the typical duration for the AI Research Annotation project?
07What background is considered ideal for this Software Engineer - AI Research Annotation position?
08How does Keystone Recruitment handle payments for this independent contractor role?
09What opportunities exist for top performers in this AI Research Annotation role?
Explore similar opportunities that match your background