Staff Software Engineer, AAI Research

Requirements

• Bachelor's degree or equivalent practical experience
• 8 years of experience working with Large Language Models (LLMs) and building agents

Preferred Qualifications

• Solid understanding of essential concepts such as tokens, context, Retrieval-Augmented Generation (RAG), and function calling
• Strong understanding of data and familiarity with basic statistical analysis concepts (e.g., variance, p-value, bias) and general data science principles
• Solid understanding of core ML concepts, training algorithms, and best practices for evaluation
• Familiarity with running quality interactions, involving understanding business goals, defining technical metrics, implementing evaluation frameworks, designing experiments, analyzing results, performing RCAs, formulating hypotheses, and conducting ablation or live experiments
• Proficiency in Python

What You'll Be Doing

• Execute quality iterations on reference agents identifying potential model or agent framework improvements
• Source or facilitate creation of datasets for evaluation and training to improve model performance for Cloud customers
• Design new agentic systems and context engineering algorithms, utilizing existing models and identifying the need for new training/evaluation objectives where necessary
• Define and implement metrics that correspond to business problems
• Prototype and iterate on the solution working closely with customers, product management, and business development

Perks and Benefits

Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.

Google is proud to be an equal opportunity and affirmative action employer, committed to building a workforce that is representative of the users served.

If you have a need for accommodation, please complete the Accommodations for Applicants form.

Google is a global company, and English proficiency is a requirement for all roles unless stated otherwise.

Google does not accept agency resumes and is not responsible for any fees related to unsolicited resumes.