Together AI

AI infrastructure System Engineer Bangalore

Together AI · Bangalore, India

Posted about 3 months ago

or apply directly on Together AI's site. We never take the application ourselves.

Is this posting real?

This role has been open
81 days
Together AI's roles stay open a median of 81 days
Reposted
No
Salary listed
No
72% of Together AI's roles list one
Ghost-job risk at Together AI
high
59 stale, 0 reposted of 61 open
Hiring momentum
77 roles opened in the last 90 days
↑ up vs. the prior 90 days
Last confirmed on the employer's board
2026-10-23

Measured from postings appearing on and disappearing from Together AI's own greenhouse board since 2026-08-03. Full hiring picture for Together AI.

About this role

In this role at Together AI, you will design and build automation systems for managing a large fleet of GPUs used in AI model training and inference. Your responsibilities will include developing software for fleet automation, monitoring hardware health, and improving operational efficiency through automation, all while collaborating with various teams to enhance AI infrastructure.

Our read on this posting2.4out of 5
benefits
1/5
freshness
1/5
career value
5/5
role clarity
5/5
pay transparency
0/5

Scored from the posting itself — how clearly the role is described, how much it says about pay and benefits, and how recently it was listed. Not a judgement of Together AI as an employer.

What you need

  • 3+ years building distributed systems, infrastructure platforms, or large-scale backend software
  • Strong software engineering skills in Python, Go, or Rust
  • Experience building platforms, automation systems, or developer infrastructure
  • Experience with Linux, Kubernetes, Terraform, Ansible, or similar infrastructure technologies
  • Strong systems thinking with the ability to understand problems across hardware and software
  • A passion for solving complex infrastructure challenges through software

Nice to have

  • GPU infrastructure, CUDA, NCCL, NVLink/NVSwitch
  • InfiniBand or RoCE networking
  • Bare-metal provisioning and lifecycle management
  • Large-scale AI training or inference clusters
  • Hardware health monitoring and predictive failure detection

Worth weighing

  • No salary listed
  • Role emphasizes automation and software development over traditional infrastructure tasks
  • Focus on large-scale systems may require a strong problem-solving mindset

Summarised from Together AI's posting. Read the full original.

Listed by Together AI on their greenhouse job board, last confirmed open on 2026-10-23. PitchMeAI is not the employer.

More roles at Together AI

All 61 open roles at Together AI →

Apply to an AI infrastructure System Engineer Bangalore position at Together AI