Job Overview
Who's the hiring manager?
Sign up to PitchMeAI to discover the hiring manager's details for this job. We will also write them an intro email for you.
Job Description
Software Engineer – AI Code Evaluator at Alignerr
Alignerr is seeking experienced software engineers in Poland to join our team as AI Code Evaluators. In this role, you will leverage your deep expertise in programming languages like TypeScript, Ruby, Java, or C++ to meticulously evaluate and enhance frontier AI models. Your primary focus will be identifying and rectifying bugs, hallucinations, and subtle failure modes within AI-generated code, ensuring the highest standards of quality and reliability.
What You'll Do
- Evaluate the performance of frontier language models on complex software engineering tasks.
- Identify bugs, logical errors, hallucinations, and reliability issues in model outputs.
- Design and review prompts, test cases, and evaluation scenarios for advanced coding workflows.
- Provide precise written feedback explaining model strengths, weaknesses, and edge cases.
- Work across multiple languages and codebases to assess generalization and correctness.
Who You Are
- Possess 3–4+ years of professional software engineering experience.
- Demonstrate strong proficiency in at least one of: TypeScript, Ruby, Java, or C++.
- Exhibit excellent written and spoken English communication skills.
- Show a demonstrated ability to reason about complex systems and debug non-obvious issues.
- Be familiar with modern AI / LLM tooling (Git, CLI workflows, testing frameworks, etc.).
- Have the ability to critically evaluate model behavior rather than simply use model outputs.
Why Join Us
- Enjoy competitive pay and flexible remote work arrangements.
- Work on cutting-edge AI projects in collaboration with top research labs.
- Benefit from freelance perks including autonomy, flexibility, and global collaboration.
- Explore potential for ongoing work and contract extensions.
Application Process (Takes 10–15 min)
- Submit your resume.
- Complete a short screening.
- Project matching and onboarding.
PS: Our team reviews applications daily. Please complete your application steps to be considered for this opportunity.
Key skills/competency
- Software Engineering
- AI Code Evaluation
- TypeScript
- Ruby
- Java
- C++
- Debugging
- AI Models
- LLM Tooling
- Prompt Engineering
How to Get Hired at Alignerr
- Tailor your resume: Highlight your software engineering experience, specific language proficiencies (TypeScript, Ruby, Java, C++), and AI/LLM tooling familiarity.
- Emphasize debugging skills: Showcase your ability to reason about complex systems and identify non-obvious issues.
- Prepare for screening: Be ready to discuss your experience with AI model evaluation and critical analysis of code.
- Apply promptly: Complete all application steps quickly as applications are reviewed daily.
Frequently Asked Questions
Find answers to common questions about this job opportunity
Explore similar opportunities that match your background