Senior Staff Software Engineer, AI Agent Platform, Vertex
Senior Staff Software Engineer, AI Agent Platform, Vertex
Requirements
Bachelor’s degree or equivalent practical experience.
8 years of experience in software development.
7 years of experience leading technical project strategy, ML design, and working with ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
5 years of experience in systems architecture and large-scale serving infrastructure.
Experience delivering technical solutions in a changing environment.
Experience working in multinational or internationalised (i18n) organisations on global initiatives.
Nice to Haves
Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
8 years of experience with data structures and algorithms.
5 years of experience in a technical leadership role leading project teams and setting technical direction.
3 years of experience working in a complex, matrix organisation involving cross-functional, cross-timezone or cross-business projects.
Experience in serving Generative AI models using inference frameworks or hardware accelerators (e.g., GPUs, TPUs).
What You'll Be Doing
Architect, develop, and maintain horizontally scalable APIs and backend infrastructure tailored specifically for Generative AI workloads.
Optimize routing, load balancing, quota management, and data plane mechanisms connecting user API requests to backend ML serving clusters across massive TPU and GPU fleets.
Prototype and launch new API products rapidly in a highly collaborative environment to expose the latest advancements in Google’s foundation models.
Collaborate closely with ML researchers, ML serving teams, and product managers to translate complex AI capabilities into intuitive, reliable enterprise-grade APIs.
Define and implement best practices for API security, high availability, fault tolerance, and comprehensive observability across distributed systems.