Software Engineer
Keystone Recruitment
Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.

Job Description
About the Software Engineer Role
This is a remote, project-based opportunity for experienced technical professionals interested in contributing to the advancement of AI-assisted software development. You will support the evaluation and improvement of advanced AI systems by assessing how AI models reason about code, generate technical solutions, and explain complex engineering concepts.
Key Responsibilities
- Evaluate AI-generated responses for technical accuracy and reasoning quality
- Validate code outputs through execution and structured testing
- Review algorithmic correctness, system design logic, and performance considerations
- Identify factual errors, logical gaps, inefficiencies, or unclear explanations
- Provide structured annotations and feedback according to evaluation guidelines
- Apply consistent technical standards across various programming tasks
Required Qualifications
- Bachelor’s, Master’s, or PhD in Computer Science or a related field
- 5+ years of professional experience in software engineering, systems design, or data science
- Proficiency in at least two programming languages such as Python, Java, C++, etc.
- Proven ability to solve complex algorithmic and systems-level problems
- Experience in reviewing production-level code for quality and performance
- Strong analytical thinking and attention to detail
- Excellent written communication skills in English
Preferred Qualifications
- Experience with AI model evaluation and technical annotation
- Background in competitive programming or advanced algorithm design
- Involvement in open-source projects
- Ability to clearly explain complex technical concepts
Engagement Details
This is an independent contractor engagement with a fully remote and flexible scheduling environment. The work is project-based, with potential extensions based on performance and project needs. Compensation is provided per the agreed contract terms.
Key skills/competency
- Software Engineering
- AI Evaluation
- Data Science
- Systems Design
- Programming
- Testing
- Algorithm Analysis
- Technical Annotation
- Code Review
- Analytical Thinking
How to Get Hired at Keystone Recruitment
- Customize your resume: Tailor it to highlight coding and evaluation skills.
- Showcase technical proficiency: List programming languages and project work.
- Research Keystone Recruitment: Understand their client base and projects.
- Prepare for technical interviews: Practice code review and algorithm challenges.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background