Software Engineer Code QA
Taskify AI
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Role Overview
As a Software Engineer Code QA at Taskify AI, you will contribute to high-impact research collaborations with leading AI labs. This role focuses on building evaluation datasets to assess AI reasoning, explanation quality, and technical judgment in coding-related interactions.
This opportunity is ideal for engineers who enjoy critical thinking about code, articulating technical reasoning, and shaping AI systems' understanding of software development workflows.
About the Project
The project concentrates on code-based question-and-answer datasets that evaluate natural-language reasoning and technical explanation quality, rather than just executable correctness. Tasks simulate authentic, chat-style developer prompts, including inline context like code snippets, error messages, logs, configuration files, and feature requirements.
Key Responsibilities
- Craft realistic developer prompts across categories such as code review, debugging, error diagnosis, configuration issues, and refactoring and design trade-offs.
- Source and adapt content from real pull requests to create authentic technical scenarios.
- Write clear, technically accurate model responses demonstrating strong reasoning and explanation quality.
- Ensure responses reflect sound engineering judgment and best practices.
Ideal Qualifications
- 2+ years of experience in software engineering, technical research, or technical education/content development.
- Bachelor's degree in Computer Science, Software Engineering, or related field (advanced degree preferred).
- Strong proficiency in one or more languages such as Python, JavaScript, Java, or C++.
- Hands-on experience with debugging, testing, and code validation.
- Strong technical writing skills and attention to detail.
- Ability to clearly articulate trade-offs, assumptions, and reasoning.
Project Details
- Start Date: Immediate
- Duration: 1–2 months
- Commitment: Part-time (15–25 hours per week, with flexibility up to 40 hours per week)
- Fully remote and asynchronous
Application & Onboarding Process
To apply, submit your resume, complete a short AI-led interview (approx. 15 minutes), and await follow-up communication within a few days for next steps and onboarding.
Compensation & Contract Terms
- $70–$120 per hour, depending on experience and expertise.
- Weekly payments via supported payment platforms.
- Independent contractor classification.
- Project scope may be extended, shortened, or concluded based on performance and business needs.
- No access to confidential or proprietary information from any employer, client, or institution.
Key skills/competency
- Software Engineering
- Code Quality Assurance
- AI Reasoning Evaluation
- Technical Writing
- Debugging
- Testing
- Code Validation
- Python
- JavaScript
- Java
- C++
How to Get Hired at Taskify AI
- Research Taskify AI's mission: Understand their work in AI evaluation and contribution.
- Tailor your resume: Highlight experience in software engineering, QA, and technical writing for AI projects.
- Showcase technical communication: Prepare to articulate complex technical reasoning clearly during interviews.
- Master core programming skills: Demonstrate proficiency in Python, JavaScript, Java, or C++ and debugging expertise.
- Prepare for AI-led interview: Practice concise, clear responses for the automated screening process.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background