Member of Engineering (Evaluations)

Requirements

• Experience with Large Language Models (LLM)
• Good taste, and a curious mindset
• Strong engineering background
• Programming experience

What You'll Be Doing

• Research and implementation of evaluations and benchmarks; both for base models and for instruction following models
• Collaborate with both applied research and product teams to define meaningful metrics and evaluations
• Work in a team: plan future steps, discuss, and communicate clearly with your peers

Perks and Benefits

• Fully remote work & flexible hours
• 37 days/year of vacation & holidays
• Health insurance allowance for you and dependents
• Company-provided equipment
• Wellbeing, always-be-learning and home office allowances
• Frequent team get togethers
• Great diverse & inclusive people-first culture