or apply directly on Jobgether's site. We never take the application ourselves.
Is this posting real?
- This role has been open
- 9 days Jobgether's roles stay open a median of 12 days
- Reposted
- No
- Salary listed
- No 0% of Jobgether's roles list one
- Ghost-job risk at Jobgether
- low 0 stale, 0 reposted of 4,675 open
- Hiring momentum
- 24620 roles opened in the last 90 days ↑ up vs. the prior 90 days
- Last confirmed on the employer's board
- 2026-09-17
Measured from postings appearing on and disappearing from Jobgether's own lever board since 2026-08-04. Full hiring picture for Jobgether.
About this role
The SWE-Bench AI Task Auditor role is a freelance position focused on auditing software engineering tasks that are used to train and evaluate AI models. The job involves evaluating complex codebases, validating task logic, and ensuring that tests and evaluation criteria are reliable. The auditor will identify integration problems and provide actionable feedback to enhance task quality, all while working independently in a flexible freelance environment.
- benefits
- 1/5
- freshness
- 4/5
- career value
- 4/5
- role clarity
- 4/5
- pay transparency
- 0/5
Scored from the posting itself — how clearly the role is described, how much it says about pay and benefits, and how recently it was listed. Not a judgement of Jobgether as an employer.
What you need
- Experience in software engineering
- Ability to evaluate complex codebases
- Skills in validating task logic and evaluation criteria
- Experience in identifying integration problems and test failures
- Capability to provide actionable feedback for task improvement
What you get
- Flexible freelance environment
- Opportunity to work independently on project-based assignments
Worth weighing
- Freelance position may lack job security
- Role may involve challenging technical evaluation work that requires deep expertise
Summarised from Jobgether's posting. Read the full original.
Listed by Jobgether on their lever job board, last confirmed open on 2026-09-17. PitchMeAI is not the employer.