Staff Software Engineer, GPU Performance, Core ML

Requirements:

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development and with data structures/algorithms (e.g., C++ or Python).
• 5 years of experience with Machine Learning (ML) design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• Experience working with GPUs.
• Experience in a technical leadership role leading project teams and setting technical direction.

Nice to Haves:

• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• Experience with compiler optimization, code generation, and runtime systems for GPU architectures (OpenXLA, MLIR, Triton, etc.).
• Expertise in tailoring algorithms and ML models to exploit GPU strengths and minimize weaknesses.
• Knowledge of low-level GPU programming (CUDA, OpenCL, etc.) and performance tuning techniques.
• Understanding of modern GPU architectures, memory hierarchies, and performance bottlenecks.
• Ability to develop and utilize sophisticated performance models and benchmarks to guide optimization efforts and hardware roadmap decisions.

What You'll Be Doing:

• Build optimizations that improve benchmarks, but also power Google's most critical products and services, impacting billions of users worldwide and driving significant cloud revenue.
• Shape the entire GPU software stack through influencing model design, optimizing low-level kernels and compilers (OpenXLA, JAX, Triton), and bridging the gap between model developers and hardware for optimal co-design and performance.
• Resolve the most challenging performance bottlenecks and explore groundbreaking optimization techniques through Google's unparalleled access to the latest generation of GPUs, world-class tooling, and a decade of experience building AI accelerators.
• Collaborate with experts in ML, compiler design, and systems architecture through internal and external partnerships, as well as open-source projects.

Perks and Benefits:

• Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
• Equal opportunity and affirmative action employer committed to building a workforce that is representative of the users we serve.
• English proficiency is a requirement for all roles unless stated otherwise in the job posting.