Staff Software Engineer, AI Data, Evaluation Platform
AI Summary ✨
Requirements:
Bachelor’s degree or equivalent practical experience.
8 years of experience with ML design and architecture; and testing/launching software products.
5 years of experience in software development, data structures and algorithms in Python.
5 years of experience in leading technical project strategy, machine learning (ML) design, and optimizing ML infrastructure (e.g., model deployment, model evaluation, data processing, debugging, fine tuning).
Experience in full-stack development languages and technologies (e.g., Python, Angular or Typescript).
Nice to Have:
5 years of experience in a technical leadership role leading project teams and setting technical direction.
5 years of experience with data structures/algorithms.
Experience in Data Science or adjacent work or on SWE/DS collaborations and with machine learning/GenAI evaluation or related fields (e.g., model training or evaluation processes, TPU optimization).
Experience working with co-owned systems or closely integrated systems maintained across team boundaries and working across time zones and maintaining productivity with limited communication bandwidth.
Knowledge of software engineering principles, design patterns, and architectural best practices.
Excellent communication skills; with ability to articulate technical concepts.
What You'll Be Doing:
Design, develop, test, and maintain features across the full stack for EvalHub and related systems such as Gemini Data Studio from our Angular/TypeScript front-end to our Python back-end services.
Collaborate across organisations and locations to develop and execute on the roadmap for eval quality efforts, enhance the end-to-end generative AI and Agent Eval UX by managing key issues in data visualization, debugging UI, and item visualization for eval data set and eval quality metrics.
Lead the design and implementation of solutions in specialized machine learning (ML) areas, optimize ML infrastructure, and guide the development of model optimization and data processing strategies.
Provide technical leadership on projects. Manage project priorities, deadlines, and deliverables.
Facilitate alignment and clarity across teams on goals, outcomes and timelines. Influence and coach a distributed team of engineers.
Perks and Benefits:
Information collected and processed as part of your Google Careers profile is subject to Google's Applicant and Candidate Privacy Policy.
Google is an equal opportunity and affirmative action employer.
If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
English proficiency is a requirement for all roles unless stated otherwise in the job posting.