GenAI Performance Engineer @ Modular
Your Application Journey
Email Hiring Manager
Job Details
About Modular
At Modular, we’re on a mission to revolutionize AI infrastructure by systematically rebuilding the AI software stack from the ground up. Our team of industry leaders and experts is building cutting-edge, modular infrastructure that simplifies AI development and deployment.
If you’re passionate about shaping the future of AI and creating tools that make a real difference, we want you on our team.
About The Role
ML developers face significant friction in deploying trained models. At Modular, we are developing a next generation AI platform to radically improve AI model deployment performance. As a GenAI Performance Engineer, you will join a small team of generalist engineers optimizing the performance of Modular’s MAX product across wide-ranging models and hardware.
- Collaborate with Kernel, Graph Compiler, and Cloud teams
- Develop and apply performance analysis tooling
- Benchmark across various CPU, GPU, and Accelerator hardware
- Build statistical models to optimize performance and cloud costs
- Drive state-of-the-art performance for diverse use cases
What You Will Do
- Measure, analyze, and identify performance improvement opportunities
- Partner with product and customer teams to design realistic benchmarks
- Collaborate on new model families and hardware optimization
- Design and benchmark advanced serving features and algorithms
- Develop statistical models to extract performance insights
What You Bring To The Table
- 5+ years in performance analysis, tooling, or benchmarking
- Expertise in performance measurement, modeling, and analysis
- Extensive experience with Python
- Creative problem solving with production-quality software experience
- Strong written and verbal communication skills
What Modular Brings To The Table
- Amazing team of experienced leaders
- World-class benefits including premier insurance and 401k matching
- Competitive compensation including stock options
- Regular team building events and travel opportunities
- A supportive and growth-focused culture
Key skills/competency
- GenAI
- Performance
- Benchmarking
- Python
- Analysis
- Cloud
- MAX product
- Hardware
- Tooling
- Collaboration
How to Get Hired at Modular
🎯 Tips for Getting Hired
- Research Modular's culture: Study their mission, values, and recent news.
- Customize your resume: Highlight performance and Python expertise.
- Prepare technical examples: Showcase benchmarking and analysis projects.
- Practice clear communication: Demonstrate results in past roles.