Senior Staff Software Engineer, Applied AI, Google Cloud

Requirements:

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development.
• Experience working with Large Language Models (LLMs) and building agents.

Nice to haves:

• Proficiency in Python.
• Familiarity with running quality interactions, which involves understanding business goals, defining aligned technical metrics, implementing evaluation frameworks, designing experiments, analyzing results, performing RCAs, formulating hypotheses for improvements, and conducting ablation or live experiments.
• Understanding of core ML concepts, training algorithms, best practices for evaluation.
• Understanding of data and familiarity with basic statistical analysis.

What you'll be doing:

• Create high-quality datasets for evaluation and training to improve model performance for Cloud customers.
• Design new agentic systems and context engineering algorithms, utilizing existing models and identifying need for new training/evaluation objectives where necessary.
• Define and implement metrics that correspond to business problems.
• Prototype and iterate on the solution working closely with customers, product management and business development.
• Design and implement evaluation frameworks and tooling for dataset creation and curation.

Perks and benefits:

• Opportunity to work on next-generation technologies.
• Be part of a fast-paced and innovative team.
• Collaborate with brilliant AI leaders and work on projects with global impact.
• Equal opportunity and affirmative action employer commitment.
• Global collaboration and English proficiency requirement.