Senior AI Engineer
@ Underdog.io -Apply to top tech jobs in 60 seconds. A place where companies apply to you

Hybrid
$150,000
Hybrid
Full Time
Posted 24 days ago

Your Application Journey

Personalized Resume
Apply
Email Hiring Manager
Interview

Email Hiring Manager

XXXXXXXXXX XXXXXXXXXXX XXXXXXXXX******* @underdog.io
Recommended after applying

Job Details

Senior AI Engineer

Underdog.io is a fast-growing automation startup backed by top-tier investors. We are on a mission to transform how Managed Service Providers (MSPs) work by eliminating mundane tasks through intelligent tools.

What You’ll Do

  • Design and ship AI features that solve real MSP pain points such as natural-language workflow creation, autonomous agents, and context-aware task automation.
  • Build agentic systems that balance automation with responsible escalation to humans.
  • Optimize production-grade AI systems by tuning prompts, RAG pipelines, and inference stacks (OpenAI, Anthropic, open-source LLMs) for speed, cost, and reliability.
  • Integrate AI into core workflows using tools like LangChain, LlamaIndex, and custom orchestration layers.
  • Collaborate cross-functionally to transform prototypes into fully shipped features.
  • Solve complex challenges such as reducing hallucinations and embedding empathy in AI interactions.

Tech Stack

  • Core: Python, FastAPI, Celery, PostgreSQL, React
  • AI/ML: OpenAI, Anthropic, Mistral/LLaMA, LangChain, Pinecone
  • Infra: AWS/Azure, Kubernetes, Docker, Redis
  • Observability: LLM telemetry and cost optimization tools

Who You Are

You have 5+ years in software engineering with at least 2+ years of shipping production AI/ML systems. Your expertise lies in LLM integration (RAG, agentic architectures, prompt engineering) and designing human-AI interaction patterns that balance automation and safety. You possess a builder's mindset, empathizing with MSP challenges and can translate complex technical ideas into clear user value.

Above & Beyond

  • Experience in fine-tuning/hosting open-source LLMs
  • Contributions to AI open-source projects (e.g., LangChain agents)
  • Expertise in observability and cost optimization for AI inference
  • Background in automation, agent-based systems, or MSP workflows

Why Join

  • Solve meaningful problems directly impacting IT engineers.
  • Own impactful projects with significant autonomy.
  • Benefit from competitive compensation including salary, equity, and benefits.
  • Work remotely in a fast-paced, execution-focused startup environment.

Key skills/competency

  • AI
  • ML
  • LLM Integration
  • Automation
  • Prompt Engineering
  • Python
  • FastAPI
  • LangChain
  • Agentic Systems
  • Cloud Infrastructure
Apply without a personalized resume

How to Get Hired at Underdog.io -Apply to top tech jobs in 60 seconds. A place where companies apply to you

🎯 Tips for Getting Hired

  • Research Underdog.io's culture: Study their mission, investor news, and reviews.
  • Customize your resume: Highlight production AI/ML achievements.
  • Showcase technical projects: Detail LLM integrations and prompt tuning.
  • Prepare for interviews: Practice real-world problem solving and collaboration examples.

📝 Interview Preparation Advice

Technical Preparation

Review LLM integration case studies.
Practice prompt engineering exercises.
Optimize Python production workflows.
Simulate container deployments using Docker.

Behavioral Questions

Explain resolving production challenges.
Describe effective cross-team collaboration.
Discuss balancing automation with human input.
Share examples of complex problem solving.

Frequently Asked Questions