or apply directly on Valarian's site. We never take the application ourselves.
Is this posting real?
- This role has been open
- 36 days Valarian's roles stay open a median of 56 days
- Reposted
- No
- Salary listed
- No 0% of Valarian's roles list one
- Ghost-job risk at Valarian
- high 9 stale, 2 reposted of 11 open
- Hiring momentum
- 13 roles opened in the last 90 days ↑ up vs. the prior 90 days
- Last confirmed on the employer's board
- 2026-10-23
Measured from postings appearing on and disappearing from Valarian's own lever board since 2026-08-04. Full hiring picture for Valarian.
About this role
As an AI Engineer at Valarian Technologies, you will be responsible for designing and maintaining evaluation frameworks for AI models, focusing on experimental design and statistical validation. Your role involves creating robust evaluation datasets, developing automated judging systems, and conducting error analyses to enhance the performance of multi-step agentic systems. You will collaborate with engineering teams to implement improvements based on your insights and findings.
- benefits
- 4/5
- freshness
- 1/5
- career value
- 4/5
- role clarity
- 5/5
- pay transparency
- 0/5
Scored from the posting itself — how clearly the role is described, how much it says about pay and benefits, and how recently it was listed. Not a judgement of Valarian as an employer.
What you need
- Grounding in Statistics & Experimental Design
- LLM-as-a-Judge Validation
- Evaluation Dataset Engineering
- Evaluation of Non-Deterministic Multi-Step Systems
- Metric Design & Integrity
- Rigor in Error Analysis
Nice to have
- Experience with agent and evaluation frameworks (e.g., LangChain, LangGraph, AutoGen, lm-evaluation-harness, Promptfoo, or Ragas)
- Exposure to running evaluation pipelines or agent workloads within secure, enclave, or Kubernetes environments.
What you get
- Equity
- A competitive salary
- Employer pension contributions
- Private health insurance
- Hybrid work setup
- Gym memberships
Worth weighing
- Role involves working in an emerging domain with no standard playbook
- Focus on statistical validation and rigorous experimental design may not appeal to all candidates
- Hybrid work model requires in-office presence three days a week
Summarised from Valarian's posting. Read the full original.
Listed by Valarian on their lever job board, last confirmed open on 2026-10-23. PitchMeAI is not the employer.
More roles at Valarian
- Senior Infrastructure EngineerLondon
- Forward Deployed EngineerLondon
- Release EngineerLondon
- FinOps ManagerLondon
- TechOps EngineerLondon
- Senior Technical Product ManagerLondon
- Head of Information SecurityLondon