Requirements:

• You enjoy rapidly building prototypes that demonstrate the boundaries of what LLMs are capable of
• You have spent dozens of hours reviewing complex data and LLM outputs
• You are obsessive about rigorously measuring AI capabilities
• You have strong software engineering skills

What You'll Be Doing:

• Create ambitious new evaluation benchmarks that push the limits of what our models can accomplish
• Work on highly cross-functional teams to translate model feedback into trustworthy evaluations
• Conduct research to advance the state-of-the-art in LLM evaluation methods
• Build scalable and reusable tools for digging into model performance

Perks and Benefits:

• A weekly lunch stipend of $75/£75 or equivalent in your local currency
• Full health and dental benefits, including mental health budget
• RRSP matching, 401K, Pension Scheme
• 100% Parental Leave top-up for up to 6 months
• Annual enrichment benefits: Arts & culture, fitness/wellness, quality time, workspace improvement credit
• Education & learning stipend for conferences, courses, and coaching
• 6 weeks of paid vacation
• Budget for traveling to other offices if remote, plus an annual company offsite