Want to get hired at Underdog.io -Apply to top tech jobs in 60 seconds. A place where companies apply to you?

Senior AI Engineer

Underdog.io -Apply to top tech jobs in 60 seconds. A place where companies apply to you

HybridHybrid

Original Job Summary

About Senior AI Engineer

Underdog.io is a fast-growing automation startup backed by top-tier investors. We are on a mission to transform how Managed Service Providers (MSPs) work by eliminating mundane tasks through intelligent tools. Join us if you care about why AI matters and want to build agentic AI that gives overwhelmed IT engineers their time back.

What You’ll Do

  • Design and ship AI features addressing real MSP pain points including natural-language workflow creation, autonomous agents, and context-aware task automation.
  • Build agentic systems that act responsibly, balancing automation with human input.
  • Optimize production-grade AI with tuned prompts, RAG pipelines, and inference stacks (OpenAI, Claude, open-source LLMs) for speed, cost, and reliability.
  • Integrate AI into core workflows using tools like LangChain, LlamaIndex, and custom orchestration layers.
  • Collaborate cross-functionally to transform prototypes into shippable features while solving hard problems like reducing hallucinations and embedding empathy into AI interactions.

Tech Stack You’ll Use

  • Core: Python, FastAPI, Celery, PostgreSQL, React
  • AI/ML: OpenAI, Anthropic, Mistral/LLaMA, LangChain, Pinecone
  • Infra: AWS/Azure, Kubernetes, Docker, Redis
  • Observability: LLM telemetry and cost optimization

Who You Are

  • 5+ years in software engineering with 2+ years shipping production AI/ML systems.
  • Expert in LLM integration, designing human-AI interaction patterns, and working with orchestration frameworks.
  • Builder mindset that prioritizes user impact over mere model hype.
  • Empathetic towards MSP challenges with a bonus for RPA/automation experience.
  • Excellent communication skills to translate complex technical ideas into user value.

Above & Beyond

  • Experience in fine-tuning/hosting open-source LLMs.
  • Contributions to AI open-source projects (e.g., LangChain agents).
  • Expertise in observability and AI inference cost optimization.
  • Background in automation and agent-based systems for MSP workflows.

Why Join

  • Solve meaningful problems that directly help overworked IT engineers.
  • Take ownership with autonomy on high-stakes AI decisions.
  • Benefit from competitive compensation including salary, equity, and benefits.
  • Engage in a remote-first culture with execution-obsessed builders.
  • Focus on results over endless demos.

Key skills/competency

  • Python
  • AI/ML
  • LLM
  • LangChain
  • FastAPI
  • Celery
  • MSP
  • Docker
  • Kubernetes
  • OpenAI

How to Get Hired at Underdog.io -Apply to top tech jobs in 60 seconds. A place where companies apply to you

🎯 Tips for Getting Hired

  • Research Underdog.io's culture: Study their mission, values, and tech innovations.
  • Customize your resume: Highlight AI and production experience.
  • Showcase real projects: Emphasize LLM integrations and responsible AI.
  • Prepare for interviews: Practice technical and behavioral questions.

📝 Interview Preparation Advice

Technical Preparation

Review Python and FastAPI fundamentals.
Practice LLM integration techniques and frameworks.
Study orchestration tools like LangChain.
Optimize inference and cost management strategies.

Behavioral Questions

Explain handling complex project challenges.
Describe teamwork in cross-functional settings.
Share experiences balancing autonomy and safety.
Detail communication of technical complexities.