Software Engineer Code QA

Role: Software Engineer Code QA

Join our client's team as a Software Engineer Code QA, a fully remote role supporting high-impact research collaborations with leading AI labs. You will be instrumental in building evaluation datasets designed to rigorously assess AI reasoning, explanation quality, and technical judgment in coding-related interactions.

This opportunity is perfect for engineers who possess a critical eye for code, can clearly articulate technical reasoning, and are keen to influence how AI systems comprehend software development workflows.

About the Project

This project centers on developing code-based question-and-answer datasets that prioritize the evaluation of natural-language reasoning and technical explanation quality over mere executable correctness. Tasks are structured to simulate realistic, chat-style developer prompts, incorporating all necessary context inline, such as:

• Code snippets
• Error messages
• Logs
• Configuration files
• Feature requirements

The primary goal is to replicate authentic developer interactions to accurately evaluate AI systems' reasoning capabilities.

Key Responsibilities

• Craft realistic developer prompts covering categories like code review, debugging, error diagnosis, configuration issues, and refactoring/design trade-offs.
• Source and adapt content from genuine pull requests to construct authentic technical scenarios.
• Write clear, technically accurate model responses that showcase strong reasoning and explanation quality.
• Ensure all responses reflect sound engineering judgment and adhere to best practices.

Ideal Qualifications

• 2+ years of experience in software engineering, technical research, or technical education/content development.
• Bachelor’s degree in Computer Science, Software Engineering, or a related field (advanced degree preferred).
• Strong proficiency in programming languages such as Python, JavaScript, Java, or C++.
• Hands-on experience with debugging, testing, and code validation.
• Strong technical writing skills and meticulous attention to detail.
• Ability to clearly articulate trade-offs, assumptions, and underlying reasoning.

Project Details

This project is immediate, with a duration of 1–2 months. It requires a part-time commitment of 15–25 hours per week, with flexibility up to 40 hours per week. The role is fully remote and asynchronous.

Application & Onboarding Process

To apply, submit your resume, complete a brief AI-led interview (approx. 15 minutes), and await follow-up communication within a few days for next steps and onboarding.

Compensation & Contract Terms

Compensation ranges from $70–$120 per hour, depending on experience and expertise, with weekly payments via supported platforms. This is an independent contractor role. The project scope is flexible, and contractors will not access confidential information from other employers.

Key Skills/Competency

• Software Engineering
• Code Quality Assurance
• AI Reasoning Evaluation
• Technical Writing
• Debugging & Testing
• Python/JavaScript/Java/C++
• Problem Solving
• Code Review
• Technical Explanations
• Software Development Workflows