Staff Software Engineer, AI/ML Performance and Accelerators

Requirements:

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience with software development in C++ and Python.
• 5 years of experience with ML infrastructure, including performance analysis and optimisation of distributed systems.
• 5 years of experience modeling or evaluating performance for large-scale machine learning workloads (e.g., Large Language Models).
• Experience with hardware-software co-design, ML accelerators, and low-level software stacks such as compilers.

Nice to haves:

• Master’s degree or PhD in Computer Science, or a related technical field.
• Experience in the self-driving or automotive industry building large-scale distributed infrastructure and networking systems.
• Experience in building high-fidelity HW/SW simulators (C++/Python) and large-scale performance tooling for ML accelerators.
• Understanding of large-scale AI workloads (LLMs), agentic systems, and performance/cost analysis for hyperscale systems.
• Knowledge of compiler flows, hardware-software co-design, and translating frameworks like PyTorch or JAX to hardware instructions.
• Ability to collaborate cross-functionally to translate performance insights into actionable hardware roadmap improvements.

What you'll be doing:

• Define, implement, and validate performance and cost metrics for current and future workloads; analyze systems from chip to network to identify bottlenecks and optimize performance.
• Co-design hardware and system features, including compute, networking, and memory, for evolving workloads while identifying future hardware and software opportunities to improve ML performance.
• Build, maintain, and validate high-fidelity Hardware and Software (HW/SW) simulators in C++ and Python to enable rapid evaluation of solutions, alongside developing methods to measure, visualize, and analyze ML performance.
• Develop and maintain comprehensive benchmarks and, when appropriate, propose changes to ML models and systems to enhance overall infrastructure efficiency and end-to-end results.
• Collaborate cross-functionally with computer architects, hardware designers, and ML model owners to communicate findings and turn analysis results into actionable hardware and software roadmap improvements.

Perks and benefits:

• Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
• Google is proud to be an equal opportunity and affirmative action employer.
• If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
• Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.
• To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.