Lead Research Scientist/Engineer (Embedded Evaluations)
Lead Research Scientist/Engineer (Embedded Evaluations)
Requirements
No formal background or industry experience required; self-taught candidates welcome.
Strong data analysis and pattern recognition skills to handle large, messy datasets and identify anomalies.
Experience writing for high-stakes audiences, communicating complex findings effectively.
Proficiency as an AI power-user with experience using various models and experimenting with AI workflows.
Expertise in scheming-related topics such as metagaming, evaluation awareness, deception, and reward-seeking.
Hands-on experience with frontier reinforcement learning and complex post-training pipelines.
Project management experience: owning ambitious projects end-to-end under strict deadlines, managing teams, and keeping research on schedule amid delays.
Unimpeachable professionalism with strong interpersonal skills for negotiations and partner interactions.
Strong mission commitment to reducing risks related to loss of control in AI development.
Nice to Haves
Strong software engineering skills, especially in Python.
Prior embedded expertise from fields like auditing or consulting involving on-site client work.
What You'll Be Doing
On-site embedded evaluators: spending weeks or months embedded at frontier AI labs conducting interviews, reviewing and gathering evidence, writing reports, and executing a playbook under high pressure.
Applied researchers: preparing and supporting on-site evaluators, developing conceptual frameworks and tooling for embedded evaluation, connecting fundamental research to on-site activities, and converting research methodologies into practical procedures.
Both roles involve quick execution, strong planning and research skills, and ownership of ambitious projects under tight deadlines.
Perks and Benefits
Market-competitive salary ranges depending on position and experience (Lead or IC roles).
Equity and comprehensive benefits including health, dental, and vision insurance.
Unlimited vacation and sick leave.
Up to 6 months paid parental leave.
Retirement savings plans with competitive employer matching.
Provided lunch, dinner, and snacks on workdays.
Paid work trips including retreats, business travel, and conferences.
$1,000 yearly professional development budget.
Relocation support and visa sponsorship for UK and US as applicable.