LLM Engineer

About Gotfriends

Gotfriends is an innovative startup at the intersection of Fintech and HealthTech, developing a disruptive platform designed to eliminate billions of dollars in medical billing errors for US-based organizations. Backed by a premier Israeli venture capital firm and following a significant Seed round, the company is building a high-impact product that acts as an automated financial safeguard for self-insured employers.

The company is located in a prime, train-accessible hub in Central Israel and operates a hybrid work model with one day of remote flexibility.

Role Overview: LLM Engineer

As an LLM Engineer, you will be crucial in designing and integrating AI-driven services into a robust production environment, with a heavy focus on LLM-based components. You will be responsible for building and optimizing production-level AI pipelines using advanced techniques such as RAG, Agentic workflows, and sophisticated prompt engineering. This role involves developing and maintaining high-performance AI services, ensuring low latency and high accuracy within cloud-based backend architectures. You will also expand the core product by developing specialized agents and adapting models to solve complex domain-specific challenges, working closely with Data Science teams to bridge the gap between model research and scalable engineering.

Key Responsibilities

• Design and integrate AI-driven services with a focus on LLM components.
• Build and optimize production-level AI pipelines using RAG and Agentic workflows.
• Implement sophisticated prompt engineering techniques.
• Develop and maintain high-performance, low-latency AI services in cloud environments.
• Expand core product features by creating specialized agents and adapting models.
• Collaborate with Data Science teams to ensure scalable engineering solutions.

Requirements

• 5+ years of professional software development experience – Mandatory.
• Proven hands-on experience in LLM development, including RAG and agentic architectures – Mandatory.
• Strong proficiency in Python and modern Machine Learning frameworks – Mandatory.
• Significant experience developing and deploying within Cloud environments – Mandatory.
• Background in Fintech, HealthTech, or complex data-driven platforms – Significant Advantage.

Key skills/competency

• LLM development
• AI pipelines
• RAG (Retrieval Augmented Generation)
• Agentic workflows
• Prompt engineering
• Python programming
• Machine Learning frameworks
• Cloud environments (AWS, GCP, Azure)
• Fintech/HealthTech domain
• Scalable engineering