Software Engineer, AI Research Annotation
Keystone Recruitment
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Software Engineer, AI Research Annotation
Join leading AI labs by applying your software engineering expertise to significantly improve model reasoning. In this role, you will review real-world coding tasks and meticulously document the problem-solving processes, directly contributing to advanced AI capabilities.
This is a Global Remote, hourly independent contractor position, with flexible hours ranging from 15-25 per week, and the option to extend up to 40 hours.
About the Project
You will support the development of advanced AI coding capabilities through the creation of structured datasets. This involves working with authentic software engineering scenarios sourced from open-source repositories to accurately capture realistic developer thought processes and decision-making.
Detailed Responsibilities
- Review AI-generated code trajectories on SWE-bench style tasks to identify key steps and decisions.
- Reconstruct step-by-step reasoning, clearly explaining solution approaches and methodologies.
- Annotate decision points, debugging strategies, and technical choices made during the problem-solving process.
- Utilize the full codebase context, including issues, tests, and pull requests, to ensure accurate and comprehensive documentation.
- Ensure all annotations reflect authentic and practical software engineering practices.
Technical Requirements
- 2+ years of hands-on software development experience, demonstrating a solid foundation in coding.
- Strong proficiency in Python, JavaScript/TypeScript, or similar modern programming languages.
- Proven experience debugging complex codebases and effectively resolving intricate issues.
- Familiarity with Git workflows, including pull requests and issue tracking systems.
- Exceptional ability to articulate technical reasoning clearly and concisely in written form.
Project Structure
- Duration: 1-2 months, with strong opportunities for extension based on performance and project needs.
- Start: Immediate onboarding is available for qualified candidates.
- Onboarding: Involves a resume review followed by a brief 15-minute AI technical interview.
- Pace: Self-scheduled work within the agreed weekly commitment minimum, offering flexibility.
- Payment: Weekly payments processed securely via Stripe or Wise.
Ideal Background
- A Bachelor's degree or higher in Computer Science, Software Engineering, or a closely related field.
- Prior experience with open-source contributions or in-depth repository analysis.
- A strong understanding of software development lifecycles and various testing methodologies.
- Comfort working extensively with technical documentation and detailed specifications.
Success Profile
Top-performing contractors are eligible for rate increases and receive priority consideration for future AI research projects. Join an elite cohort of experienced engineers who are actively shaping the next generation of coding AI.
Key skills/competency
- AI Research
- Code Annotation
- Software Development
- Python
- JavaScript/TypeScript
- Debugging
- Git Workflows
- Technical Writing
- Problem Solving
- Open Source Contribution
How to Get Hired at Keystone Recruitment
- Research Keystone Recruitment's culture: Study their mission, values, recent projects, and independent contractor testimonials.
- Highlight AI and Annotation Experience: Tailor your resume to emphasize any AI research, code annotation, or structured data creation experience.
- Showcase Technical Proficiency: Provide examples of Python/JavaScript/TypeScript skills, debugging complex codebases, and Git workflow mastery.
- Demonstrate Clear Communication: Prepare to articulate technical reasoning clearly during your 15-minute AI technical interview.
- Emphasize Independent Work: Detail your ability to manage self-scheduled tasks and deliver high-quality work as a contractor.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background