Deep Learning Engineer, LLM Accuracy Evaluation @ Lensa
Your Application Journey
Email Hiring Manager
Job Details
About the Role
Lensa is a career site that connects job seekers with great opportunities in the US. This job is promoted on behalf of NVIDIA through Lensa's network. This position is for a Deep Learning Engineer, LLM Accuracy Evaluation who will pioneer methodologies to assess performance of cutting‑edge deep learning models including LLMs, RAG, agents, and vision models.
What You’ll Be Doing
You will:
- Collaborate with partners and the open‑source community to deliver flagship models as optimized NVIDIA Inference Microservices (NIM).
- Research and develop innovative deep learning evaluation methodologies.
- Analyze, influence, and enhance AI/DL libraries, frameworks, and APIs.
- Prototype and build robust tools and infrastructure pipelines for AI initiatives.
What We Need To See
Candidates should have:
- A BS, MS, or PhD in Computer Science, AI, Applied Math or equivalent experience.
- 10+ years of hands-on experience in AI for NLP and LLMs.
- Strong problem-solving, debugging, performance analysis, test design, and documentation skills.
- Solid mathematical foundations with expertise in AI/DL algorithms.
- Excellent communication skills and ability to work independently and collaboratively in a fast-paced environment.
Ways To Stand Out
Additional advantages:
- Experience in accuracy evaluation of LLMs (OpenLLM Leaderboard or HELM).
- Hands-on experience with inference and deployment environments such as TensorRT, ONNX, or Triton.
- Passion for DevOps/MLOps practices in deep learning product development.
- Experience managing large-scale workloads in high‐performance computing clusters.
- Strong familiarity with Linux environments and containerization (e.g., Docker).
Diversity & Inclusion
NVIDIA is committed to fostering a diverse work environment. All qualified candidates are encouraged to apply without regard to race, religion, color, national origin, gender, sexual orientation, age, veteran status, disability, or any other protected characteristic.
Key Skills/Competency
Deep Learning, LLM, AI, NVIDIA, Inference, Microservices, TensorRT, ONNX, Triton, HPC
How to Get Hired at Lensa
🎯 Tips for Getting Hired
- Research Lensa's and NVIDIA's cultures: Understand their mission and recent projects.
- Customize your resume: Highlight deep learning and AI evaluation experience.
- Prepare technical stories: Be ready with real-world deep learning examples.
- Network strategically: Connect with current employees on LinkedIn.