Human Evaluation Researcher
Nuance Labs · Seattle, Washington
Posted 16 days ago · $160,000 – $190,000
or apply directly on Nuance Labs's site. We never take the application ourselves.
Is this posting real?
- This role has been open
- 16 days Nuance Labs's roles stay open a median of 45 days
- Reposted
- No
- Salary listed
- Yes 100% of Nuance Labs's roles list one
- Ghost-job risk at Nuance Labs
- high 7 stale, 0 reposted of 8 open
- Hiring momentum
- 9 roles opened in the last 90 days ↑ up vs. the prior 90 days
- Last confirmed on the employer's board
- 2026-09-17
Measured from postings appearing on and disappearing from Nuance Labs's own greenhouse board since 2026-08-03. Full hiring picture for Nuance Labs.
About this role
As a Human Evaluation Researcher at Nuance Labs, you will design and conduct qualitative and quantitative studies to evaluate AI avatars, focusing on aspects like naturalness and emotional resonance. Your role involves developing measurement instruments, ensuring inter-rater agreement, and calibrating automated metrics against human judgment. You will work closely with the founders and the modeling team, owning the human evaluation process from start to finish.
- benefits
- 5/5
- freshness
- 4/5
- career value
- 4/5
- role clarity
- 5/5
- pay transparency
- 5/5
Scored from the posting itself — how clearly the role is described, how much it says about pay and benefits, and how recently it was listed. Not a judgement of Nuance Labs as an employer.
What you need
- 5+ years designing and running human-subjects research in industry or academia
- Strong grounding in qualitative and quantitative research methods
- Experience with study designs that achieve consensus on ambiguous judgments
- Fluency with agreement and reliability metrics
- Ability to communicate findings clearly to ML researchers
Nice to have
- Experience evaluating generative AI or digital humans
- Background in perceptual science or psychophysics
- Familiarity with human evaluation at scale
- Statistics and scripting skills (Python or R)
What you get
- $160,000 – $190,000 base salary
- Meaningful equity
- Health plans with ~$2,000 in annual HSA contributions
- $2,000/year wellness stipend
- One-time $500 for work setup
- 15 days of PTO and 10 public holidays
Worth weighing
- In-person work required five days a week
- The role is hands-on and may require quick turnaround studies
- No specific mention of remote work options or flexibility
- The position involves subjective evaluation, which may lead to ambiguous results
Summarised from Nuance Labs's posting. Read the full original.
Listed by Nuance Labs on their greenhouse job board, last confirmed open on 2026-09-17. PitchMeAI is not the employer.