Staff Software Engineer, GPU Performance, Core ML

Requirements:

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development and with data structures/algorithms (e.g., C++ or Python).
• 5 years of experience with Machine Learning (ML) design and ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
• Experience working with GPUs.
• Experience in a technical leadership role leading project teams and setting technical direction.

Nice to haves:

• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• Experience with compiler optimization, code generation, and runtime systems for GPU architectures (OpenXLA, MLIR, Triton, etc.).
• Expertise in tailoring algorithms and ML models to exploit GPU strengths and minimize weaknesses.
• Knowledge of low-level GPU programming (CUDA, OpenCL, etc.) and performance tuning techniques.
• Understanding of modern GPU architectures, memory hierarchies, and performance bottlenecks.
• Ability to develop and utilize sophisticated performance models and benchmarks to guide optimization efforts and hardware roadmap decisions.

What you'll be doing:

• Build optimizations that improve benchmarks, but also power Google's most critical products and services, impacting billions of users worldwide and driving significant cloud business.
• Shape the entire GPU software stack through influencing model design, optimizing low-level kernels and compilers (OpenXLA, JAX, Triton), and bridging the gap between model developers and hardware for optimal co-design and performance.
• Resolve the most challenging performance bottlenecks and explore groundbreaking optimization techniques through Google's unparalleled access to the latest generation of GPUs, tooling, and a decade of experience building AI accelerators.
• Collaborate with experts in ML, compiler design, and systems architecture through internal and external partnerships, as well as open-source projects.

Perks and benefits:

• Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
• Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of various factors.
• If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
• Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.
• To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.