Senior Staff Software Engineer, AI Agent Platform, Vertex

Requirements

• Bachelor’s degree or equivalent practical experience.
• 8 years of experience in software development.
• 7 years of experience leading technical project strategy, ML design, and working with ML infrastructure.
• 5 years of experience in systems architecture and large-scale serving infrastructure.
• Experience delivering technical solutions in a changing environment.
• Experience working in multinational or internationalised (i18n) organisations on global initiatives.

Nice to Haves

• Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
• 8 years of experience with data structures and algorithms.
• 5 years of experience in a technical leadership role leading project teams and setting technical direction.
• 3 years of experience working in complex, matrix organisations involving cross-functional projects.
• Experience in serving Generative AI models using inference frameworks or hardware accelerators.

What You'll Be Doing

• Architecting, developing, and maintaining robust, horizontally scalable APIs and backend infrastructure tailored for Generative AI workloads.
• Optimizing routing, load balancing, and data plane mechanisms for ML serving clusters.
• Prototyping and launching new API products rapidly in a collaborative environment.
• Collaborating with ML researchers and product managers to translate complex AI capabilities into enterprise-grade APIs.
• Defining and implementing best practices for API security, high availability, and fault tolerance.

Perks and Benefits

• Individual pay based on skills, experience, and education.
• Competitive salary and bonus structure.
• Equity options.
• Comprehensive benefits package.
• Opportunity to work at the forefront of Generative AI revolution.