Senior Software Engineer, Vertex AI First-Party

Requirements:

• Bachelor's degree in Computer Science or equivalent practical experience.
• 5 years of experience building and developing large-scale infrastructure or distributed systems.

Nice to haves:

• Experience programming in C, C++, Java, or Python.
• Experience building or optimizing inference systems for Large Language Models (LLMs) or multimodal models (audio/video).
• Experience implementing trust and safety features, abuse detection classifiers, or data residency controls.
• Experience designing unified APIs or middleware that abstracts complexity for other developers.
• Track record of debugging production issues in high-throughput, low-latency environments.

What you'll be doing:

• Design, develop, and deploy software infrastructure to unify and serve large language and multimodal models across cloud environments.
• Implement responsible AI, engineering real-time safety filters, abuse detection mechanisms, and compliance controls directly into the serving stack to ensure secure and ethical AI usage.
• Drive improvements in system latency, efficiency, and stability. Identify bottlenecks and resolve production issues.
• Collaborate closely with research scientists and global engineering teams to transform model breakthroughs into enterprise-ready products.
• Write high-quality, testable, and maintainable code while contributing to technical design reviews and engineering best practices.

Perks and benefits:

• Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
• Equal opportunity and affirmative action employer commitment.
• Global company with English proficiency requirement unless stated otherwise.
• Opportunity for accommodation by completing Accommodations for Applicants form.
• Recruitment agencies note: Google does not accept agency resumes.