or apply directly on Together AI's site. We never take the application ourselves.
Is this posting real?
- This role has been open
- 22 days Together AI's roles stay open a median of 45 days
- Reposted
- No
- Salary listed
- No 72% of Together AI's roles list one
- Ghost-job risk at Together AI
- high 42 stale, 0 reposted of 61 open
- Hiring momentum
- 77 roles opened in the last 90 days ↑ up vs. the prior 90 days
- Last confirmed on the employer's board
- 2026-09-17
Measured from postings appearing on and disappearing from Together AI's own greenhouse board since 2026-08-03. Full hiring picture for Together AI.
About this role
The Senior Software Engineer for Infra Agent Systems will develop and maintain software systems that automate and manage one of the largest GPU fleets globally. Responsibilities include building production AI agents for diagnosing and remediating infrastructure issues, creating a robust core platform with knowledge graphs and orchestration frameworks, and ensuring the performance and reliability of these systems in a production environment.
- benefits
- 1/5
- freshness
- 4/5
- career value
- 5/5
- role clarity
- 5/5
- pay transparency
- 0/5
Scored from the posting itself — how clearly the role is described, how much it says about pay and benefits, and how recently it was listed. Not a judgement of Together AI as an employer.
What you need
- 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms
- Strong systems design skills and experience owning significant systems from design through production
- Depth in at least one of the following: AI agent systems, orchestration, tool use, evaluation, or grounding
- Knowledge graphs or graph data modeling
- Search, retrieval, ranking, RAG, or semantic search systems
- Strong backend engineering experience, including API design, service boundaries, data modeling, and integrations across complex systems
Nice to have
- Experience in GPU infrastructure, datacenters, bare-metal systems, hardware failure modes, BMC/IPMI, or cluster schedulers
- Graph databases
- Event-driven systems and messaging platforms such as NATS or Kafka
- Observability platforms such as Prometheus and Grafana
- Building evaluation frameworks or improving the quality and reliability of LLM-powered systems
Worth weighing
- Role involves both development and operational responsibilities, which may require on-call support
- Focus on cutting-edge AI technologies and infrastructure, which may involve a steep learning curve
- Remote position based in India may have different collaboration dynamics compared to in-office roles
Summarised from Together AI's posting. Read the full original.
Listed by Together AI on their greenhouse job board, last confirmed open on 2026-09-17. PitchMeAI is not the employer.
More roles at Together AI
- Strategic Finance Senior Associate - ComputeSan Francisco
- Senior Product Manager, Model APIs & Developer ExperienceSan Francisco
- Manager, International Cloud SourcingSan Francisco or NYC
- Junior/Senior/Staff Software Engineer, Inference / Compute Infrastructure EngineeringAmsterdam
- Junior/Senior or Staff Software Engineer, Inference / Compute Infrastructure EngineeringIndia
- HR Coordinator- AmsterdamAmsterdam, Netherlands
- Staff Software Engineer, Inference / Compute Infrastructure EngineeringLondon & Amsterdam
- Senior Software Engineer — Infra Agent Systems UKLondon