PitchMeAI
Jobgether

Senior Python Engineer - AI Code Evaluation (Codex / Claude Code, up to $200/hr)

Jobgether · US

Location
US
Posted
5 days ago
Type
Contract / Remote
Salary
Not listed — worth asking early.
Tailored resumekeyword-matched to this role.
Hiring managerwe find who's hiring.
Intro emaildrafted to reach them directly.

What the job really is

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Python Engineer - AI Code Evaluation based in the United States.

This is a senior-level contract opportunity focused on evaluating the quality of interactions between developers and modern AI coding agents.
Rather than building production software, you’ll apply your engineering judgment to assess whether AI-generated responses reflect strong technical reasoning and practical engineering standards.
You’ll review coding-agent interactions for usefulness, correctness, clarity, and overall quality of engineering judgment.
The role requires a strong sense of engineering “taste” and the ability to make subjective assessments that are still rigorous and well supported.
You’ll help distinguish excellent AI-assisted development experiences from responses that are technically valid but confusing, misleading, or poorly reasoned.
You’ll work with tools such as Codex, Claude Code, and Cursor in a flexible, remote environment.
The engagement offers senior engineers the opportunity to directly influence how AI coding systems are evaluated and improved.

Similar roles

Open positions we recommend based on this role.