Engineering Manager, Inference Benchmarking - AI Perf
Ladders · United States
- Hybrid
- Full-time
- $290,250 / year
- United States
Tailored resume — keyword-matched to this role.
Hiring manager — we find who's hiring.
Intro email — drafted to reach them directly.
Job highlights
- Lead AI performance benchmarking infrastructure.
- Ensure benchmark result accuracy and soundness.
- Integrate engines with various company teams.
- Hire and mentor senior engineers.
- Influence architecture and technology capabilities.
About the role
Engineering Manager, AI Performance Benchmarking
We are seeking an Engineering Manager for Inference Benchmarking to join a leader in the Telecommunications & Hardware space. This role will lead work at the intersection of data, AI-enabled capabilities, and scalable technology delivery. You will work across engineering, product, operations, and business stakeholders to translate complex requirements into practical technology solutions. The position offers the opportunity to influence architecture, execution quality, and the technology capabilities that enable long-term growth within a Telecommunications & Hardware environment.
Responsibilities
- Drive the technical roadmap for AIPerf's core infrastructure including load generation and microservices.
- Ensure accuracy and statistical soundness of benchmark results for industry-wide engineering use.
- Advise on upstream engine integrations with various teams to maintain AIPerf's relevance.
- Hire, mentor, and grow a team of senior engineers in an open-source environment.
Qualifications
- Bachelor's degree in Computer Science, Electrical Engineering, or related field or equivalent experience.
- 8+ years of software engineering experience in performance-critical infrastructure, ML tooling, or distributed systems.
- 3+ years of leadership experience as a tech lead, TLM, or engineering manager.
- Deep understanding of LLM inference mechanics and measurement reproducibility.
- Proven track record of cross-functional collaboration in high-visibility environments.
Benefits
- Comprehensive benefits package
- Equity options
- Flexible working arrangements
- Opportunities for professional development
- Access to cutting-edge technologies and projects
Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.
Key skills/competency
- Engineering Management
- AI Performance Benchmarking
- Inference
- LLM
- Scalable Technology Delivery
- Performance-critical Infrastructure
- ML Tooling
- Distributed Systems
- Cross-functional Collaboration
- Open-source Environment
Skills & topics
- Engineering Manager
- AI
- Performance Benchmarking
- Inference
- LLM
- Machine Learning
- Distributed Systems
- Telecommunications
- Hardware
- Leadership
How to get hired
- Tailor your resume: Highlight experience in performance-critical infrastructure, ML tooling, and distributed systems, aligning with the Engineering Manager, AI Performance Benchmarking role.
- Showcase leadership: Emphasize your 3+ years of experience as a tech lead, TLM, or engineering manager, detailing your team growth and mentorship achievements.
- Demonstrate technical depth: Detail your understanding of LLM inference mechanics and measurement reproducibility, along with your experience in performance-critical infrastructure.
- Highlight collaboration: Provide examples of successful cross-functional collaboration in high-visibility environments, crucial for this Engineering Manager position.
- Engage with the application: Follow application instructions carefully and express enthusiasm for the Telecommunications & Hardware industry and AI performance.
Technical preparation
Master LLM inference mechanics and measurement.,Optimize performance-critical infrastructure and ML tooling.,Gain expertise in distributed systems architecture.,Familiarize with load generation and microservices.
Behavioral questions
Describe a time you mentored senior engineers.,How do you ensure benchmark result accuracy?,Share an example of cross-functional collaboration.,How would you drive a technical roadmap?
Frequently asked questions
- What is the salary range for the Engineering Manager, AI Performance Benchmarking role at Ladders?
- The annual salary for the Engineering Manager, AI Performance Benchmarking position at Ladders ranges from $224,000 to $356,500, depending on experience and qualifications.
- Is this Engineering Manager role remote or on-site?
- This Engineering Manager, AI Performance Benchmarking role is remote, but candidates must be US-based.
- Does Ladders offer visa sponsorship for the Engineering Manager position?
- No, Ladders does not offer visa sponsorship for the Engineering Manager, AI Performance Benchmarking role.
- What qualifications are essential for the Engineering Manager, AI Performance Benchmarking role?
- Key qualifications include a Bachelor's degree in a related field or equivalent experience, 8+ years in performance-critical infrastructure/ML tooling/distributed systems, 3+ years of leadership experience, and a deep understanding of LLM inference mechanics and measurement reproducibility.
- What kind of team will I be managing as an Engineering Manager at Ladders?
- As an Engineering Manager, AI Performance Benchmarking, you will hire, mentor, and grow a team of senior engineers in an open-source environment.
- What are the benefits offered for this Engineering Manager role?
- The role offers a comprehensive benefits package, equity options, flexible working arrangements, opportunities for professional development, and access to cutting-edge technologies.
- What is the company culture like for the Engineering Manager position?
- The company is a leader in Telecommunications & Hardware, valuing cross-functional collaboration and innovation. They are an equal opportunity employer encouraging diverse backgrounds.
- How does Ladders encourage applications from candidates who don't meet every qualification?
- Ladders explicitly encourages applications from candidates who may not meet every qualification, believing that diverse backgrounds are valuable to the team.