PitchMeAI Jobs
Together AI

AI Infrastructure Systems Engineer

Together AI · San Francisco

Posted about 2 months ago · $190,000 - $270,000

or apply directly on Together AI's site. We never take the application ourselves.

Is this posting real?

This role has been open
53 days
Together AI's roles stay open a median of 54 days
Reposted
No
Salary listed
Yes
72% of Together AI's roles list one
Ghost-job risk at Together AI
high
45 stale, 0 reposted of 61 open
Hiring momentum
77 roles opened in the last 90 days
↑ up vs. the prior 90 days
Last confirmed on the employer's board
2026-09-26

Measured from postings appearing on and disappearing from Together AI's own greenhouse board since 2026-08-03. Full hiring picture for Together AI.

About this role

As an AI Infrastructure Systems Engineer at Together AI, you will design and build automation systems for managing a large fleet of GPUs used in AI model training and inference. Your role will involve creating software that enhances GPU availability and performance, developing platforms for monitoring hardware health, and collaborating with various teams to optimize AI infrastructure operations.

Our read on this posting3.6out of 5
benefits
2/5
freshness
1/5
career value
5/5
role clarity
5/5
pay transparency
5/5

Scored from the posting itself — how clearly the role is described, how much it says about pay and benefits, and how recently it was listed. Not a judgement of Together AI as an employer.

What you need

  • 3+ years building distributed systems, infrastructure platforms, or large-scale backend software
  • Strong software engineering skills in Python, Go, or Rust
  • Experience building platforms, automation systems, or developer infrastructure
  • Experience with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies
  • Strong systems thinking with the ability to understand problems across hardware and software
  • A passion for solving complex infrastructure challenges through software

Nice to have

  • GPU infrastructure, CUDA, NCCL, NVLink/NVSwitch
  • InfiniBand or RoCE networking
  • Bare-metal provisioning and lifecycle management
  • Large-scale AI training or inference clusters
  • Hardware health monitoring and predictive failure detection

What you get

  • competitive compensation
  • startup equity
  • health insurance
  • other competitive benefits

Worth weighing

  • no specific mention of remote work options
  • the role emphasizes automation and software over traditional infrastructure tasks
  • the salary range is broad and dependent on experience and location

Summarised from Together AI's posting. Read the full original.

Listed by Together AI on their greenhouse job board, last confirmed open on 2026-09-26. PitchMeAI is not the employer.

More roles at Together AI

All 61 open roles at Together AI →