Ruby on Rails Developer - Remote
YO IT Consulting · United States
- Hybrid
- Full-time
- $80,000 / year
- United States
Tailored resume — keyword-matched to this role.
Hiring manager — we find who's hiring.
Intro email — drafted to reach them directly.
Job highlights
- Evaluate AI systems using software engineering tasks.
- Work on diverse backend and full-stack projects.
- Debug, improve, and explain code clearly.
- Identify and communicate technical tradeoffs.
- Adapt to new codebases and technologies.
About the role
Software Engineering - AI Systems Evaluator
We are looking for experienced software engineers to help train and evaluate next-generation AI systems through real-world software engineering tasks. This role is best suited for developers who can reason through unfamiliar codebases, explain engineering decisions clearly, and solve practical backend, full-stack, systems, or infrastructure-related problems. No prior AI experience is required. What matters most is strong software engineering judgment, clean technical communication, and the ability to evaluate code, architecture, tradeoffs, and implementation quality.
Key Responsibilities
- Work on challenging software engineering tasks across backend, full-stack, infrastructure, and systems-related projects.
- Review, debug, improve, and explain code across different technical environments.
- Design or evaluate practical solutions involving APIs, databases, services, integrations, testing, and deployment workflows.
- Identify tradeoffs around scalability, maintainability, performance, reliability, security, and developer experience.
- Communicate technical reasoning clearly in writing, including why a solution works and what alternatives were considered.
- Collaborate with the customer’s team on technical reviews, implementation decisions, and problem-solving exercises.
- Adapt quickly to new codebases, frameworks, and technical requirements.
Required Skills And Qualifications
- 5+ years of hands-on software engineering experience.
- Strong experience in at least one backend or full-stack engineering environment, such as Python, JavaScript/TypeScript, Node.js, Java, C#, .NET, C++, Go, Ruby, PHP, or similar.
- Experience building, maintaining, or reviewing production-level applications, APIs, services, databases, or integrations.
- Strong understanding of software engineering fundamentals, including debugging, testing, code quality, architecture, and technical tradeoffs.
- Ability to explain complex engineering decisions clearly and objectively.
- Comfortable reading and reasoning through unfamiliar code or technical requirements.
Preferred Qualifications
- Experience with cloud environments such as AWS, GCP, or Azure.
- Experience with CI/CD pipelines, DevOps workflows, containers, monitoring, or production operations.
- Experience with frontend frameworks such as React, Next.js, Angular, Vue, or React Native.
- Open-source contributions, public GitHub work, technical writing, or strong examples of past engineering work.
- Experience mentoring engineers, reviewing code, or making architecture decisions.
Key skills/competency
- Software Engineering
- AI Systems Evaluation
- Backend Development
- Full-Stack Development
- Code Review
- Technical Communication
- Problem Solving
- System Design
- Debugging
- Testing
Skills & topics
- Software Engineer
- AI Systems
- Backend Development
- Full-Stack Development
- Ruby
- Python
- Java
- JavaScript
- Code Review
- Technical Communication
- Remote Work
- Contractor
How to get hired
- Tailor your resume: Highlight your 5+ years of software engineering experience, focusing on backend, full-stack, and production-level application development.
- Showcase technical depth: Emphasize your ability to reason through unfamiliar code, explain engineering decisions, and identify technical tradeoffs.
- Quantify achievements: Use specific examples of debugging, code improvement, and collaboration on challenging projects in your application.
- Prepare for technical interviews: Be ready to discuss your experience with various programming languages, databases, APIs, and cloud environments.
- Demonstrate communication skills: Practice articulating complex technical concepts clearly and concisely, as this is crucial for evaluating AI systems.
Technical preparation
Practice debugging unfamiliar codebases quickly.,Review common API, database, and service patterns.,Prepare to explain code quality and tradeoffs.,Brush up on fundamentals of testing and deployment.
Behavioral questions
Explain a complex engineering decision you made.,Describe how you evaluate technical tradeoffs.,How do you adapt to new technical requirements?,How do you communicate technical reasoning clearly?
Frequently asked questions
- What is the work arrangement for the Software Engineer AI Systems Evaluator role at YO IT Consulting?
- This Software Engineer AI Systems Evaluator position at YO IT Consulting is fully remote, allowing you to work from anywhere.
- What are the expected hours for the Software Engineer AI Systems Evaluator role at YO IT Consulting?
- The role requires a commitment of 10-12 hours per week, making it suitable for experienced developers seeking part-time, contract work.
- Do I need prior AI experience to apply for the Software Engineer AI Systems Evaluator position?
- No, prior AI experience is not required for this role at YO IT Consulting. Strong software engineering judgment and communication skills are prioritized.
- What specific technical skills are most important for the Software Engineer AI Systems Evaluator role?
- The most critical skills include 5+ years of software engineering experience, proficiency in at least one backend or full-stack environment (like Ruby, Python, Java), and a strong understanding of software engineering fundamentals.
- How can I best prepare for the technical interview for the Software Engineer AI Systems Evaluator job?
- Prepare to discuss your experience with production-level applications, APIs, databases, and services. Be ready to explain your reasoning on code quality, architecture, and technical tradeoffs, and to work through unfamiliar code scenarios.
- What kind of projects will I be working on as a Software Engineer AI Systems Evaluator at YO IT Consulting?
- You will engage in challenging software engineering tasks across backend, full-stack, infrastructure, and systems projects, focusing on training and evaluating AI systems by working with real-world code.
- Is this a contract or permanent position at YO IT Consulting?
- This is a contractor position, offering flexibility for experienced software engineers looking for part-time engagement.