
Senior Software Engineer — AI Code Ranking
Alignerr · Berlin, Berlin, Germany
- Hybrid
- Contract
- $80,000 / year
- Berlin, Berlin, Germany
Job highlights
- Evaluate and rank AI-generated code.
- Shape future of AI code generation.
- Remote, flexible hourly contract role.
- Utilize programming languages: Python, JS, Java, etc.
- Requires 5+ years experience.
About the role
About The Role
What if your deep software engineering expertise could directly shape how the next generation of AI writes code? We're looking for senior-level developers in the Berlin area to evaluate, compare, and rank AI-generated code — helping AI systems learn what separates good code from great code.
You'll review pairs of code solutions, assess them on correctness, efficiency, readability, and best practices, and provide the preference rankings that teach AI models to produce better software. Your engineering judgment becomes the training signal that makes AI smarter.
This is a fully remote, flexible contract role designed for experienced software engineers who want meaningful, intellectually engaging work on their own schedule.
Organization
Alignerr
Type
Hourly Contract
Location
Remote
Commitment
10–40 hours/week
What You'll Do
- Compare pairs of AI-generated code solutions and rank them based on quality, correctness, and engineering best practices
- Evaluate code for functional accuracy — verifying that solutions produce correct outputs across standard and edge cases
- Assess code quality factors including readability, efficiency, maintainability, and adherence to idiomatic patterns
- Identify bugs, logic errors, security issues, and performance bottlenecks in AI-generated code
- Write clear, structured justifications explaining your ranking decisions
- Work across multiple programming languages and problem domains — from algorithms and data structures to systems design and API integrations
- Complete task-based assignments independently on your own schedule
Who You Are
- Senior-level software engineer with 5+ years of professional development experience
- Proficient in at least two of the following: Python, JavaScript/TypeScript, Java, C++, Go, or Rust
- Strong understanding of algorithms, data structures, and computational complexity
- Experienced in code review — you can quickly spot issues and articulate what makes one solution better than another
- Deep knowledge of software engineering best practices: clean code, design patterns, testing, and performance optimization
- Clear written communicator who can explain technical reasoning concisely
- Self-motivated and consistent when working independently without supervision
Nice to Have
- Experience with machine learning, AI/ML pipelines, or training data curation
- Background in competitive programming, technical interviewing, or algorithmic problem-solving
- Familiarity with RLHF (Reinforcement Learning from Human Feedback) or preference-based AI training
- Experience across both backend and frontend development
- Contributions to open-source projects or technical mentoring experience
- Knowledge of security best practices and common vulnerability patterns
Why Join Us
- Work on cutting-edge AI projects alongside leading research labs
- Fully remote and flexible — work when and where it suits you
- Freelance autonomy with the structure of meaningful, task-based work
- Your engineering expertise directly shapes how AI understands and generates code at scale
- Intellectually stimulating work that keeps your skills sharp across languages and domains
- Potential for ongoing work and contract extension as new projects launch
Key skills/competency
- Senior Software Engineer
- AI Code Ranking
- Python
- JavaScript
- Java
- C++
- Go
- Rust
- Code Review
- Software Engineering Best Practices
Skills & topics
- Senior Software Engineer
- AI Code Ranking
- Software Development
- Code Review
- Python
- JavaScript
- Java
- C++
- Go
- Rust
- Algorithms
- Data Structures
- Remote Work
- Contract Role
- AI
- Machine Learning
How to get hired
- Tailor your resume: Highlight your 5+ years of experience, proficiency in at least two specified languages (Python, JS, Java, C++, Go, Rust), and strong understanding of algorithms, data structures, and computational complexity. Emphasize your code review experience and knowledge of software engineering best practices.
- Craft a compelling application: Clearly articulate your technical reasoning and ability to work independently in your cover letter. Showcase any experience with AI, ML, competitive programming, or open-source contributions.
- Prepare for technical discussions: Be ready to discuss your approach to evaluating code quality, correctness, efficiency, and adherence to best practices. Practice explaining complex technical concepts concisely, as this role requires clear written communication.
- Demonstrate self-motivation: Highlight instances where you've worked independently and delivered high-quality results on schedule. Alignerr values self-starters for this flexible contract role.
Technical preparation
Behavioral questions
Frequently asked questions
- What programming languages are essential for the Senior Software Engineer AI Code Ranking role at Alignerr?
- For the Senior Software Engineer AI Code Ranking position at Alignerr, proficiency in at least two of the following languages is required: Python, JavaScript/TypeScript, Java, C++, Go, or Rust.
- What is the work arrangement for this Senior Software Engineer role?
- This Senior Software Engineer AI Code Ranking role at Alignerr is a fully remote, flexible contract position, allowing you to work from anywhere.
- How does my engineering judgment directly impact AI at Alignerr?
- Your engineering judgment as a Senior Software Engineer at Alignerr directly shapes AI models by providing the preference rankings for AI-generated code. This training signal helps AI systems learn to produce better, more efficient, and correct software.
- What kind of experience is Alignerr looking for in candidates for the AI Code Ranking job?
- Alignerr is seeking Senior Software Engineers with 5+ years of professional development experience, a strong understanding of algorithms and data structures, and significant experience in code review and software engineering best practices for the AI Code Ranking role.
- Is this a full-time or part-time opportunity with Alignerr?
- This Senior Software Engineer AI Code Ranking role at Alignerr is an hourly contract position with a commitment of 10-40 hours per week, offering flexibility in your work schedule.
- What are the key responsibilities of a Senior Software Engineer at Alignerr focusing on AI code?
- Key responsibilities include evaluating, comparing, and ranking AI-generated code based on quality, correctness, efficiency, and best practices. You will also identify bugs and provide clear justifications for your ranking decisions.