Senior Developer Technology Engineer - Windows LLM & GenAI Open-Source Ecosystem

Requirements:

• 5+ years of professional experience in local GPU deployment, profiling, and optimization.
• BS or MS degree in Computer Science, Engineering, or related field.
• Strong proficiency in C/C++, Python, and software design.
• Familiarity with Windows operating system.
• Theoretical understanding of Transformer architectures, LLMs, Generative AI, and convolutional neural networks.
• Experience with open-source LLM and GenAI software.
• Experience with CUDA and Nsight GPU profiling and debugging suite.
• Strong verbal and written communication skills in English.
• Excellent organization, problem-solving, time management, and task prioritization skills.
• Excellent interpersonal skills.
• Some travel required for conferences and on-site visits.

What you'll be doing:

• Improve Windows LLM & GenAI user experience on NVIDIA RTX.
• Work on feature and performance enhancements of OSS software.
• Engage with internal product teams and external OSS maintainers.
• Solve local end-to-end LLM & Generative AI GPU deployment challenges.
• Apply profiling and debugging tools for analyzing GPU-accelerated AI applications.
• Conduct hands-on trainings, develop sample code, and host presentations.
• Guide AI application developers for efficient adoption of DL frameworks.
• Collaborate with GPU driver and architecture teams and NVIDIA research.

Nice to haves:

• Experience with GPU-accelerated AI inference using NVIDIA APIs.
• Expert knowledge in Vulkan and/or DX12.
• Detailed knowledge of the latest GPU architectures.
• Experience with AI deployment on NPUs and ARM architectures.

Perks and benefits:

• Being part of a forward-thinking and innovative team at NVIDIA.
• An opportunity to contribute to cutting-edge technology in visual computing and AI.
• A challenging and creative work environment.
• Equal opportunity employer with a focus on diversity and inclusion.