Software Engineer AI Code Evaluation

About the Opportunity

Braintrust is offering a flexible opportunity for Software Engineers across Latin America to contribute to the development of next-generation AI models. This role focuses on evaluating and improving code generated by Artificial Intelligence, allowing you to earn in USD while working remotely.

Location & Compensation

• Location: Remote (Latin America) - Candidates from Argentina, Brazil, Chile, Colombia, Costa Rica, Dominica, Mexico, Peru, Puerto Rico, and other LATAM countries are welcome.
• Pay Rate: $15.00 – $32.00 USD per hour (Rates vary by location and quality of work).
• Contract Type: Freelance / Flexible

Why Join Braintrust?

• Flexible Schedule: You control your availability, working as much or as little as you choose. A commitment of 20+ hours per week is suggested for significant returns.
• Remote & USD Pay: Earn competitive US Dollar rates from the comfort of your home, regardless of your location within Latin America.
• Cutting-Edge Work: Utilize your software engineering expertise to train Large Language Models (LLMs), helping them generate superior, safer, and more efficient code.

Required Qualifications for Software Engineer AI Code Evaluation

• Professional Experience: A minimum of 2 years of professional Software Engineering experience.
• Language Skills: Professional proficiency in written and reading English is essential.
• Technical Skills: Demonstrated proficiency in at least one major programming language (e.g., Python, Java, JavaScript, C++) and a strong grasp of computer science fundamentals.
• Code Review Skills: The ability to clearly describe, evaluate, and critique code logic and syntax in English.

Preferred Qualifications

• Bachelor’s degree in Computer Science or equivalent professional experience.
• Experience with broadly used frameworks and libraries.

What You’ll Be Working On

As a Software Engineer AI Code Evaluation, you will act as a subject matter expert, partnering with clients to ensure AI-generated code meets high-quality standards. No prior AI/ML expertise is required; your core coding knowledge is what's valued.

Example projects include:

• Evaluating Code Quality: Thoroughly reviewing AI-generated code snippets for accuracy, efficiency, and safety.
• Problem Solving: Crafting "ground truth" solutions to coding problems, which serve as learning data for the AI.
• Optimization: Refactoring and improving code for better performance and scalability.
• Test Cases: Developing robust test cases to verify the intended functionality of code.
• Documentation: Creating clear, human-readable explanations in English for code functionality and solution rationale.

Application Process

The application process for the Software Engineer AI Code Evaluation role is straightforward:

1. Apply: Submit your application for the position.
2. Assessment: Within 2 business days, you will receive email instructions to access and complete a mandatory assessment. Timely completion is highly recommended.
3. Start Working: Upon successful completion of the assessment, you will gain access to the work queue and can begin contributing.

Key skills/competency

• Software Engineering
• Code Evaluation
• AI Training
• Programming Languages (Python, Java, JavaScript, C++)
• Computer Science Fundamentals
• Code Refactoring
• Test Case Development
• Technical Documentation
• Problem Solving
• English Proficiency