Software Engineer Code QA
Taskify AI
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Role Overview: Software Engineer Code QA
One of our clients is seeking experienced Software Engineers to contribute to high-impact research collaborations with leading AI labs. In this 100% remote role, you will be instrumental in building evaluation datasets designed to assess AI reasoning, explanation quality, and technical judgment in coding interactions. This is an ideal opportunity for engineers who enjoy critical thinking about code, articulating technical reasoning, and shaping how AI systems understand software development.
About the Project
The project focuses on creating code-based question-and-answer datasets that evaluate natural-language reasoning and technical explanation quality, moving beyond simple executable correctness. Tasks simulate realistic, chat-style developer prompts, including all necessary inline context such as code snippets, error messages, logs, configuration files, and feature requirements. The goal is to evaluate AI systems' reasoning capabilities in authentic developer interactions.
Key Responsibilities
- Craft realistic developer prompts covering areas like code review, debugging, error diagnosis, configuration issues, and refactoring/design trade-offs.
- Source and adapt content from real pull requests to create authentic technical scenarios.
- Write clear, technically accurate model responses demonstrating strong reasoning and explanation quality.
- Ensure responses reflect sound engineering judgment and best practices.
Ideal Qualifications
- 2+ years of experience in software engineering, technical research, or technical education/content development.
- Bachelor’s degree in Computer Science, Software Engineering, or a related field (advanced degree preferred).
- Strong proficiency in one or more languages: Python, JavaScript, Java, or C++.
- Hands-on experience with debugging, testing, and code validation.
- Strong technical writing skills and meticulous attention to detail.
- Ability to clearly articulate trade-offs, assumptions, and reasoning.
Project Details & Logistics
- Start Date: Immediate
- Duration: 1–2 months
- Commitment: Part-time (15–25 hours per week, flexible up to 40 hours)
- Work Arrangement: Fully remote and asynchronous
Application & Onboarding Process
- Submit your resume.
- Complete a short AI-led interview (approx. 15 minutes).
- Receive follow-up communication within days regarding next steps and onboarding.
Compensation & Contract Terms
- $70–$120 per hour, based on experience.
- Weekly payments via supported platforms.
- Independent contractor classification.
- Project scope is adaptable based on performance and needs.
- No access to confidential information from other employers/clients.
Key skills/competency
- Software Engineering
- Code QA
- AI Reasoning
- Technical Writing
- Debugging
- Code Validation
- Python
- JavaScript
- Code Review
- Developer Prompts
How to Get Hired at Taskify AI
- Research Taskify AI's mission: Study their focus on AI evaluation and collaboration with leading AI labs.
- Tailor your resume: Highlight experience in Code QA, technical writing, debugging, and AI-related projects for Taskify AI.
- Showcase critical thinking: Prepare to discuss complex debugging scenarios, code review processes, and technical reasoning.
- Ace the AI-led interview: Practice articulating technical judgments concisely and clearly, aligning with Taskify AI's evaluation goals.
- Demonstrate language proficiency: Be ready to discuss your expertise in Python, Java, JavaScript, or C++ and related code validation skills.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background