Member of Engineering (Evaluations / Engineering)

Requirements

• Strong engineering background
• Experience with distributed systems including data pipelines, message queues, cloud services, and monitoring tools

What You'll Be Doing

• Designing a Python framework for implementing benchmarks
• Building and maintaining a pipeline for distributed evaluations
• Collaborating with modeling and product teams to enhance experimentation and evaluation tools

Skills & Experience

• Experience leading software projects cross functionally
• Building highly reliable and well-tested services
• Designing frameworks or tooling for developers
• Experience with ML ops and data visualization platforms

Perks & Benefits

• Fully remote work & flexible hours
• 37 days/year of vacation & holidays
• Health insurance allowance for you and dependents
• Company-provided equipment
• Wellbeing, always-be-learning, and home office allowances
• Frequent team get-togethers
• Great diverse & inclusive people-first culture