AI/LLM Engineer

About AI/LLM Engineer at Ostro

At Ostro, we are transforming how life sciences connect with the people who need their innovations most. Our patent-pending AI technology powers personalized healthcare journeys and reimagines interactions between patients, providers, and brands.

Role and Responsibilities

• Develop performant, scalable APIs and backend processes focused on LLM integration.
• Collaborate with cross-functional teams to implement and refine AI/LLM features.
• Provide strategic feedback on roadmap and feature development.
• Ensure code quality through reviews, testing, and adherence to best practices.
• Optimize performance for LLM inference and large-scale data processing.
• Stay updated on AI/LLM trends and emerging technologies.
• Troubleshoot production issues to maintain reliable LLM-driven features.

Technologies

• OpenAI, Vertex and other public LLM APIs
• Django/Python
• PostgreSQL
• GCP

Requirements

• Experience shipping LLM pipelines with preprocessing, prompt optimization, output validation, and fallback mechanisms.
• Proven experience with production use of LLM APIs (e.g., OpenAI, Gemini).
• Skilled in building systems to measure model performance and detect drift.
• Proficiency in prompt engineering.
• Strong Python and Django skills.
• 3+ years of relevant software engineering experience.
• Bachelor’s degree in computer science or equivalent work experience.

Nice to Have

• Experience with Docker/Kubernetes and CI/CD pipelines.
• Knowledge of regulated industries like healthcare or fintech.
• Experience with async tasks and workflows.
• Background in shipping production code for B2B software products.
• Familiarity with relational databases, PostgreSQL preferred.

Perks

• Impacting the future of healthcare with measurable global outcomes.
• Work directly with company founders.
• 100% remote work with occasional in-person collaboration.
• Tech and office setup reimbursement.
• Unlimited PTO, extended closures, and generous family leave.
• Competitive salary, equity, and full benefits.

Key skills/competency

• LLM Integration
• API Development
• Python
• Django
• Scalability
• Prompt Engineering
• Testing
• Cloud Platforms
• Data Processing
• Collaboration