AI Engineer
Ruby Labs · Spain
- Hybrid
- Full-time
- $150,000 / year
- Spain
Job highlights
- Shape AI infrastructure and LLM experiences.
- Own advanced prompt systems and LLM workflows.
- Utilize LangChain, LlamaIndex, Langfuse, OpenRouter.
- Drive production AI features from start to finish.
- Make data-driven decisions on model performance.
About the role
About Us
Ruby Labs is a leading tech company that creates and operates innovative consumer products. We offer a diverse range of opportunities across the health, education, and entertainment industries. Our innovative teams are driving the future of consumer-led products, and we're always looking for passionate individuals to join us. Learn more about our story at: https://rubylabs.com/about-us/
About The Role
At Ruby Labs, we’re seeking a senior AI Engineer to shape our AI infrastructure and drive production-ready LLM experiences. You’ll work in a modern stack, making data-driven decisions around model performance, reliability, and cost. You’ll own advanced prompt systems, structured outputs, and complex LLM workflows using LangChain or LlamaIndex. Observability, debugging, and evaluation are core to the role, leveraging Langfuse and AI gateways like OpenRouter to continuously improve model quality and operational efficiency. You’ll take full ownership of key AI features from experimentation to live production.
Key Responsibilities
- Advanced Prompt Engineering: Designing complex, dynamic prompt templates with conditional logic and efficiently reusing information and context within prompts to maximize generation quality and reasoning.
- Structured Outputs & Schemas: Implementing various response schemes (JSON mode, function calling, Zod/JSON schemas) to ensure AI outputs are predictable and ready for seamless integration into application logic.
- Prompt Engineering & Evaluations: Building robust evaluation pipelines and using Langfuse to collect feedback and score the quality of responses in real time.
- Tracing & Debugging: Performing deep debugging of complex LLM chains using Langfuse traces to identify bottlenecks and optimize for cost, latency, and context window usage.
- AI A/B Testing: Running systematic experiments across different models via OpenRouter (e.g., comparing Claude 3.5 Sonnet vs. GPT-4o) and analyzing results based on quantitative metrics.
- Data-Driven Decisions: Making deployment decisions for new prompts or models strictly based on quantitative benchmarks and trace data, rather than intuition.
- Output Scoring & Analysis: Developing scoring systems to analyze the “Problem → Solution” chain and identify root causes of hallucinations or logic errors using Langfuse analytics.
- Model Performance & Fine-Tuning: Regularly re-evaluating model performance as new architectures emerge and performing fine-tuning when necessary to meet specific domain requirements.
Qualifications
- Node.js & Next.js: Deep knowledge of the stack to build reliable services and handle complex LLM-generated data.
- Dynamic Prompting Skills: Proven experience in building prompts where content is highly dependent on input variables and context injection.
- OpenRouter Experience: Experience working with unified APIs, managing rate limits, and selecting the most cost-effective models for specific tasks.
- Langfuse (or similar): Understanding of LLM observability principles — setting up tracing, creating test datasets, and integrating scoring systems.
- Evaluation Methodology: Experience with frameworks like RAGAS or building custom “LLM-as-a-judge” systems.
- Analytical Mindset: Ability to transform raw generation logs into actionable business metrics and technical insights.
- Iterative Mindset: Focus on continuous product improvement through constant feedback loops.
Nice to have
- Fine-Tuning: Practical experience in fine-tuning models for specific domain tasks or JSON compliance.
- RAG Architecture: Understanding how to build and optimize Retrieval-Augmented Generation systems, including indexing, retrieval, and re-ranking.
- Python: Basic knowledge for working with data science scripts or AI evaluation libraries.
Location
Ruby Labs operates within the CET (Central European Time) zone. Applicants from any country are welcome to apply for the position as long as they are located within approximately ± 4 hours of CET. This ensures optimal collaboration and communication during working hours.
Benefits
Discover the perks of being part of our vibrant team! We offer:
- Remote Work Environment: Embrace the freedom to work from anywhere, anytime, promoting a healthy work-life balance.
- Unlimited PTO: Enjoy unlimited paid time off to recharge and prioritize your well-being, without counting days.
- Paid National Holidays: Celebrate and relax on national holidays with paid time off to unwind and recharge.
- Company-provided MacBook: Experience seamless productivity with top-notch Apple MacBooks provided to all employees who need them.
- Flexible Independent Contractor Agreement: Unlock the benefits of flexibility, autonomy, and entrepreneurial opportunities. Benefit from tax advantages, networking opportunities, reduced employment obligations, and the freedom to work from anywhere. Read more about it here: https://docs.google.com/document/d/1tzxGX4Uu7Ts_HCLFXESKLnKaaBfVCPf1f9AYZPrkjJM/preview?tab=t.0
Be part of our fast-growing team and seize this excellent opportunity for personal and professional growth!
Interview Process
After submitting your application, we conduct a thorough review which typically takes 3 to 5 days, but may occasionally take longer due to the volume of applications received. If we see a potential fit, we proceed with the following steps:
- Recruiter Screening (40 minutes)
- First Interview (60 minutes)
- Technical Interview (45 minutes)
Life at Ruby Labs
At Ruby Labs, we move fast, aim high, and expect the same from our team. We’re not here to play small—we’re here to build, grow, and win. That means we look for people who are ambitious, driven, and ready to give their best every single day. This is a place for individuals who thrive under pressure, embrace challenges, and see opportunity in every obstacle. If you’re hungry to achieve, motivated by impact, and want to grow at the speed of your own ambition, Ruby Labs offers the platform to make it happen. Here, effort is matched with reward. We recognize those who go all in and deliver results, and we create space for people who want more—more responsibility, more growth, and more success.
Key skills/competency
- Senior AI Engineer
- Node.js
- Next.js
- TypeScript
- LLM
- Prompt Engineering
- LangChain
- LlamaIndex
- Langfuse
- OpenRouter
Skills & topics
- AI Engineer
- Node.js
- Next.js
- TypeScript
- LLM
- Prompt Engineering
- LangChain
- LlamaIndex
- Langfuse
- OpenRouter
- Remote
- AI
- Machine Learning
- Software Engineer
- Developer
How to get hired
- Tailor your resume: Highlight Node.js, Next.js, LLM experience, and prompt engineering skills.
- Showcase projects: Detail your work with Langfuse, OpenRouter, or similar AI tools.
- Emphasize impact: Quantify your achievements in improving model performance and efficiency.
- Prepare for technicals: Brush up on Node.js, Next.js, and LLM concepts for interviews.
- Understand the culture: Research Ruby Labs' fast-paced, ambitious environment to align your answers.
Technical preparation
Behavioral questions
Frequently asked questions
- What are the core technologies for the Senior AI Engineer role at Ruby Labs?
- The core technologies for this Senior AI Engineer position at Ruby Labs include Node.js, Next.js, TypeScript, LLMs, prompt engineering, LangChain or LlamaIndex, Langfuse, and OpenRouter. A strong understanding of these will be crucial for success in the role.
- Is this a remote position at Ruby Labs?
- Yes, Ruby Labs offers a fully remote work environment. This allows employees the freedom to work from anywhere, promoting a healthy work-life balance.
- What is the required time zone for applicants at Ruby Labs?
- Ruby Labs operates within the CET (Central European Time) zone. Applicants should be located within approximately ± 4 hours of CET to ensure optimal collaboration during working hours.
- What are the main responsibilities of a Senior AI Engineer at Ruby Labs?
- The main responsibilities include designing advanced prompt systems, implementing structured outputs, building evaluation pipelines with Langfuse, performing deep debugging of LLM chains, running A/B tests with OpenRouter, and making data-driven decisions on model performance and fine-tuning.
- What qualifications are essential for the Senior AI Engineer role?
- Essential qualifications include deep knowledge of Node.js & Next.js, proven dynamic prompting skills, experience with OpenRouter, understanding of LLM observability principles (like Langfuse), and an analytical, iterative mindset.
- Does Ruby Labs offer unlimited Paid Time Off (PTO)?
- Yes, Ruby Labs offers unlimited PTO, allowing employees to recharge and prioritize their well-being without a strict day count.
- What is the interview process like for the Senior AI Engineer position at Ruby Labs?
- The interview process typically includes a Recruiter Screening (40 minutes), a First Interview (60 minutes), and a Technical Interview (45 minutes). Application review usually takes 3-5 days.
- What are the 'nice to have' skills for this AI Engineer role?
- Nice-to-have skills include practical experience in fine-tuning models for specific tasks or JSON compliance, understanding of RAG architecture, and basic knowledge of Python for data science scripts or AI evaluation libraries.
- How does Ruby Labs approach continuous improvement in AI?
- Ruby Labs emphasizes continuous improvement through robust evaluation pipelines using Langfuse, A/B testing models via OpenRouter, and analyzing generation logs to identify root causes of errors and optimize performance.
- What kind of work environment can I expect at Ruby Labs?
- Ruby Labs fosters a fast-paced, ambitious environment where individuals thrive under pressure, embrace challenges, and are motivated by impact and growth. Effort is matched with reward.