Software Engineer - Trajectory
Keystone Recruitment
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Overview
The Software Engineer - Trajectory role with Keystone Recruitment is a remote, hourly independent contractor position. Join leading AI labs and apply your software engineering expertise to improve model reasoning through real-world coding task reviews and detailed annotation of problem-solving processes.
Project Details
Support the development of advanced AI coding capabilities by creating structured datasets from authentic software engineering scenarios sourced from open-source repositories. You will capture realistic developer thought processes, including decision points, debugging strategies, and technical choices.
Responsibilities
- Review AI-generated code trajectories on SWE-bench tasks
- Reconstruct step-by-step reasoning and solution approaches
- Annotate decision points and debugging strategies
- Utilize full codebase context including issues, tests, and PRs
- Ensure annotations reflect authentic software engineering practices
Technical Requirements
- 2+ years hands-on software development experience
- Strong proficiency in Python, JavaScript/TypeScript or similar
- Experience in debugging complex codebases
- Familiarity with Git workflows, pull requests, and issue tracking
- Ability to articulate technical reasoning clearly in writing
Project Structure
- Duration: 1-2 months with potential extensions
- Start: Immediate onboarding
- Onboarding: Resume review and a 15-minute AI technical interview
- Pace: Self-scheduled within a minimum weekly commitment (15-25 hours, flexible up to 40)
- Payment: Weekly via Stripe/Wise
Ideal Background
Candidates should have a Computer Science or Software Engineering degree (Bachelor's or higher) along with experience in open-source contributions or repository analysis. A solid understanding of software development lifecycles, testing, and technical documentation is essential.
Success Profile
Top performers receive rate increases and priority for future AI research projects. This role offers the opportunity to work with a cohort of experienced engineers shaping next-generation coding AI.
Key skills/competency
- Software Engineering
- AI Research
- Python
- JavaScript
- Debugging
- Git Workflows
- Annotation
- Technical Writing
- Open-Source
- Problem Solving
How to Get Hired at Keystone Recruitment
- Research Keystone Recruitment's culture: Understand their approach and project focus.
- Customize your resume: Highlight AI and coding experience.
- Prepare for technical interviews: Practice problem-solving and coding tasks.
- Emphasize repository contributions: Demonstrate open-source involvement.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background