Senior Deep Learning Engineer, LLM Accuracy Evaluation

Requirements:

• BS, MS, or PhD in Computer Science, AI, Applied Math, or related field, or equivalent experience, with 5+ years of industry experience.
• 3+ years of hands-on experience in AI for natural language processing (NLP) and large language models (LLMs).
• Strong problem-solving, debugging, performance analysis, test design, and documentation skills.
• Solid mathematical foundations and expertise in AI/DL algorithms.
• Excellent written and verbal communication skills, with the ability to work independently and collaboratively in a fast-paced environment.

Nice to haves:

• Experience in accuracy evaluation of LLMs (OpenLLM Leaderboard or HELM).
• Hands-on experience with inference and deployment environments like TensorRT, ONNX, or Triton.
• Passion for DevOps/MLOps practices in deep learning product development.
• Experience running large-scale workloads in high-performance computing (HPC) clusters.
• Strong understanding of Linux environments and containerization technologies like Docker.

What you'll be doing:

• Collaborate closely with partners and the open-source community to deliver flagship models as highly optimized NVIDIA Inference Microservices (NIM).
• Research and develop innovative deep learning methodologies to evaluate new model families across diverse domains.
• Analyze, influence, and enhance AI/DL libraries, frameworks, and APIs, ensuring consistency with best engineering practices.
• Research, prototype, and build robust tools and infrastructure pipelines to support ground-breaking AI initiatives.

Perks and benefits:

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.