PitchMeAI Jobs
SambaNova Systems

Senior ML Infrastructure Engineer

SambaNova Systems · Austin, Texas, United States; San Jose, California, United States

Posted about 3 months ago

or apply directly on SambaNova Systems's site. We never take the application ourselves.

Is this posting real?

This role has been open
80 days
SambaNova Systems's roles stay open a median of 69 days
Reposted
No
Salary listed
No
0% of SambaNova Systems's roles list one
Ghost-job risk at SambaNova Systems
high
57 stale, 2 reposted of 57 open
Hiring momentum
68 roles opened in the last 90 days
↑ up vs. the prior 90 days
Last confirmed on the employer's board
2026-10-23

Measured from postings appearing on and disappearing from SambaNova Systems's own greenhouse board since 2026-08-03. Full hiring picture for SambaNova Systems.

About this role

The Senior ML Infrastructure Engineer at SambaNova will design, build, and operate the production-grade inference infrastructure for the company's Reconfigurable Dataflow Unit (RDU) architecture. This role involves optimizing advanced inference techniques for performance and cost, managing the public API surfaces, and ensuring the accuracy of the inference stack. The engineer will collaborate with multiple teams to transition features from prototype to production while contributing to technical discussions and system-level engineering solutions.

Our read on this posting3.0out of 5
benefits
5/5
freshness
1/5
career value
4/5
role clarity
5/5
pay transparency
0/5

Scored from the posting itself — how clearly the role is described, how much it says about pay and benefits, and how recently it was listed. Not a judgement of SambaNova Systems as an employer.

What you need

  • B.S. in Computer Science, Electrical Engineering, or related field
  • 5+ years of industry experience building and operating large-scale distributed systems, ideally in ML serving
  • Strong software engineering fundamentals: algorithms, data structures, concurrency, and systems design
  • Experience designing and maintaining production services with strict latency, throughput, and availability requirements
  • Working knowledge of modern LLM inference techniques and familiarity with open-source serving stacks such as vLLM, TensorRT-LLM, or SGLang
  • Proficiency in Python

What you get

  • Competitive total rewards package, including base salary and equity
  • 95% premium coverage for employee medical insurance
  • 77% premium coverage for dependents
  • Health Savings Account (HSA) with employer contribution
  • Dental and Vision insurance
  • Short/Long term Disability insurance

Worth weighing

  • No specific mention of remote work options
  • The role requires collaboration with multiple teams, which may imply a need for strong interpersonal skills
  • The salary range is quite broad, indicating potential variability based on experience and negotiation

Summarised from SambaNova Systems's posting. Read the full original.

Listed by SambaNova Systems on their greenhouse job board, last confirmed open on 2026-10-23. PitchMeAI is not the employer.

More roles at SambaNova Systems

All 57 open roles at SambaNova Systems →