Senior Staff Software Engineer, AI Agent Platform, Vertex

Requirements

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 7 years of experience leading technical project strategy, ML design, and working with ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
  • 5 years of experience in systems architecture and large-scale serving infrastructure.
  • Experience delivering technical solutions in a changing environment.
  • Experience working in multinational or internationalised (i18n) organisations on global initiatives.

Nice to Haves

  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • 8 years of experience with data structures and algorithms.
  • 5 years of experience in a technical leadership role leading project teams and setting technical direction.
  • 3 years of experience working in a complex, matrix organisation involving cross-functional, cross-timezone or cross-business projects.
  • Experience in serving Generative AI models using inference frameworks or hardware accelerators (e.g., GPUs, TPUs).

What You'll Be Doing

  • Architect, develop, and maintain horizontally scalable APIs and backend infrastructure tailored specifically for Generative AI workloads.
  • Optimize routing, load balancing, quota management, and data plane mechanisms connecting user API requests to backend ML serving clusters across massive TPU and GPU fleets.
  • Prototype and launch new API products rapidly in a highly collaborative environment to expose the latest advancements in Google’s foundation models.
  • Collaborate closely with ML researchers, ML serving teams, and product managers to translate complex AI capabilities into intuitive, reliable enterprise-grade APIs.
  • Define and implement best practices for API security, high availability, fault tolerance, and comprehensive observability across distributed systems.

Perks and Benefits

  • Competitive salary in Poland: zł640,000 - zł655,000 + 25% bonus target + equity + benefits.
  • Opportunity to shape the frontier of enterprise AI and work at the forefront of the Generative AI revolution.
  • Work within Google Cloud’s mission to empower businesses using cutting-edge AI technology.
  • Engage in a culture of empowerment, rapid development, and collaborative environment.
AI Summary ✨

Similar jobs

  • Senior Principal Engineer - Enterprise Engineering (Backend)

    AtlassianPolanda day ago
    NewRemote
    ≈ €107k – €140k / year base
  • Software Engineer III, Context Graph, Knowledge Catalog

    GooglePoland3 days ago
    ≈ €64k – €65k / year base
  • See all jobs in Poland →