Software Engineer Code QA Remote
Keystone Recruitment
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Role Overview
The Software Engineer Code QA Remote role at Keystone Recruitment supports high-impact research collaborations with leading AI labs. You will contribute to building evaluation datasets designed to assess AI reasoning, explanation quality, and technical judgment in coding-related interactions.
About the Project
This project focuses on code-based question-and-answer datasets that evaluate natural-language reasoning and technical explanation quality. You will craft realistic, chat-style developer prompts that include code snippets, error messages, logs, configuration files, and feature requirements to simulate authentic developer interactions.
Key Responsibilities
- Craft realistic developer prompts (code review, debugging, error diagnosis, configuration issues, refactoring trade-offs).
- Source and adapt content from real pull requests for authentic scenarios.
- Write clear and technically accurate model responses demonstrating strong reasoning.
- Ensure responses reflect sound engineering judgment and best practices.
Ideal Qualifications
- 2+ years experience in software engineering, technical research, or content development.
- Bachelor’s degree in Computer Science, Software Engineering, or related field.
- Proficiency in Python, JavaScript, Java, or C++.
- Strong debugging, testing, and code validation experience.
- Excellent technical writing skills and attention to detail.
Project Details
- Start Date: Immediate
- Duration: 1–2 months
- Commitment: Part-time (15–25 hours per week; up to 40 hours flexible)
- Fully remote and asynchronous
Application & Onboarding Process
Submit your resume, complete a short AI-led interview (approx. 15 minutes), and receive follow-up communication regarding next steps.
Compensation & Contract Terms
Compensation ranges from $70 to $120 per hour, depending on experience. Payments are made weekly via supported payment platforms. Role is classified as an independent contractor position with flexible project scope based on performance and business needs.
Key skills/competency
- QA
- Debugging
- Code Review
- Technical Writing
- Python
- JavaScript
- Evaluation
- Research
- Testing
- Collaboration
How to Get Hired at Keystone Recruitment
- Research Keystone Recruitment: Study their projects, values, and global scope.
- Customize your resume: Emphasize debugging and code QA skills.
- Highlight technical expertise: Include relevant programming languages.
- Prepare for AI interviews: Review technical reasoning and troubleshooting.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background