PitchMeAI Jobs
ID.me

Staff Software Engineer- AI Agent Evaluations

ID.me · Mountain View, California, United States

Posted about 2 months ago · Previously reposted

or apply directly on ID.me's site. We never take the application ourselves.

Is this posting real?

This role has been open
53 days
ID.me's roles stay open a median of 54 days
Reposted
Yes
taken down and listed again at least once
Salary listed
No
0% of ID.me's roles list one
Ghost-job risk at ID.me
high
35 stale, 1 reposted of 54 open
Hiring momentum
73 roles opened in the last 90 days
↑ up vs. the prior 90 days
Last confirmed on the employer's board
2026-09-26

Measured from postings appearing on and disappearing from ID.me's own greenhouse board since 2026-08-03. Full hiring picture for ID.me.

About this role

The Staff Software Engineer role at ID.me focuses on defining and leading the testing discipline for AI agents, particularly in evaluating LLM behavior and ensuring the reliability of these systems in production. Responsibilities include building evaluation infrastructure, establishing quality standards, mentoring engineers on AI testing best practices, and collaborating with various teams to enhance the development of AI features.

Our read on this posting3.2out of 5
benefits
5/5
freshness
1/5
career value
5/5
role clarity
5/5
pay transparency
0/5

Scored from the posting itself — how clearly the role is described, how much it says about pay and benefits, and how recently it was listed. Not a judgement of ID.me as an employer.

What you need

  • Bachelor's degree in Computer Science, Engineering, or equivalent experience
  • 8+ years building and operating production software systems
  • Demonstrated experience evaluating or testing LLM-powered features or autonomous agents in production
  • Proficiency with AI-assisted development tools (Claude Code, Cursor, or equivalent)
  • Strong backend engineering fundamentals in Python, Java, Go, or equivalent
  • Experience designing test infrastructure, CI/CD quality gates, or evaluation pipelines at scale

Nice to have

  • Background in identity verification, fraud detection, or regulated industries
  • Familiarity with Anthropic's model evaluation methodology or similar published eval research
  • Experience with observability tooling (Datadog, OpenTelemetry) applied to AI workloads
  • Track record of building developer tooling or platforms that other teams adopt widely

What you get

  • Comprehensive medical, dental, vision insurance
  • Health savings account
  • Flexible spending accounts (medical, limited purpose, dependent care, commuter benefit accounts)
  • Basic and voluntary life and AD&D insurance
  • 401(k) with company match
  • Parental leave

Worth weighing

  • No specific salary details provided beyond the range of $194,000 — $253,000 USD
  • Role requires in-office presence five days a week
  • Focus on AI systems may limit exposure to other areas of software engineering

Summarised from ID.me's posting. Read the full original.

Listed by ID.me on their greenhouse job board, last confirmed open on 2026-09-26. PitchMeAI is not the employer.

More roles at ID.me

All 54 open roles at ID.me →

Apply to a Staff Software Engineer- AI Agent Evaluations position at ID.me - Jobs near me at Mountain View, California, United States