Software Engineer, AI Training and Reasoning
The UVA VEC
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Role Overview
We are seeking experienced Software Engineers to contribute to a cutting-edge AI research initiative focused on improving how advanced models solve real-world coding challenges. In this role, you will help build high-quality training datasets by analyzing and reconstructing the reasoning behind AI-generated coding solutions. Your work will directly support the development of next-generation intelligent systems capable of deeper technical understanding and problem-solving.
About the Project
You will work on annotating model-generated solution paths derived from real-world software engineering tasks in open-source environments. Since many AI systems do not reveal their internal reasoning, this project focuses on reconstructing the logical thought process behind each step of a solution — using your own engineering judgment and full task context to infer decision-making patterns.
Key Responsibilities
- Review AI-generated coding trajectories based on realistic development tasks
- Reconstruct reasoning behind solution steps and debugging decisions
- Annotate problem-solving approaches and logical workflows
- Analyze codebases, issues, and test cases to infer accurate reasoning
- Ensure technical precision and realistic developer thinking in annotations
Ideal Qualifications
- 2+ years of hands-on software engineering experience
- Strong debugging and problem-solving skills in real codebases
- Degree in Computer Science, Software Engineering, or related field
- Proficiency in Python, JavaScript, TypeScript, or similar languages
- Familiarity with Git workflows, pull requests, and issue tracking
- Ability to clearly explain technical reasoning in structured writing
Project Timeline
- Start Date: Immediate
- Duration: 1–2 months
- Commitment: 15–25 hours/week (up to 40 hours optional)
Application Process
- Submit your resume
- Complete a short AI-led interview (~15 minutes)
- Follow-up within a few business days regarding next steps
Contract & Payment Terms
- Independent contractor engagement
- Fully remote with flexible scheduling
- Project timelines may adjust based on performance or needs
- No access to confidential third-party data required
- Weekly payments via Stripe or Wise
Key skills/competency
- Software Engineering
- AI Research
- Code Trajectory Analysis
- Debugging
- Problem-Solving
- Python
- JavaScript
- Git Workflows
- Technical Writing
- Data Annotation
How to Get Hired at The UVA VEC
- Research The UVA VEC's mission: Study their AI research focus, values, and relevant projects to align your application.
- Tailor your resume: Highlight extensive software engineering experience, strong debugging, and proficiency in Python, JavaScript, or TypeScript.
- Prepare for AI-led interview: Practice articulating complex technical reasoning and problem-solving strategies clearly and concisely.
- Showcase problem-solving skills: Emphasize experience analyzing codebases, inferring logic, and reconstructing solution paths from real-world coding challenges.
- Demonstrate technical writing ability: Be ready to explain how you would document and annotate intricate AI-generated reasoning and workflows.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background