Lead Research Scientist/Engineer (Embedded Evaluations)

Requirements

  • No formal background or industry experience required; self-taught candidates welcome.
  • Strong data analysis and pattern recognition skills to handle large, messy datasets and identify anomalies.
  • Experience writing for high-stakes audiences, communicating complex findings effectively.
  • Proficiency as an AI power-user with experience using various models and experimenting with AI workflows.
  • Expertise in scheming-related topics such as metagaming, evaluation awareness, deception, and reward-seeking.
  • Hands-on experience with frontier reinforcement learning and complex post-training pipelines.
  • Project management experience: owning ambitious projects end-to-end under strict deadlines, managing teams, and keeping research on schedule amid delays.
  • Unimpeachable professionalism with strong interpersonal skills for negotiations and partner interactions.
  • Strong mission commitment to reducing risks related to loss of control in AI development.

Nice to Haves

  • Strong software engineering skills, especially in Python.
  • Prior embedded expertise from fields like auditing or consulting involving on-site client work.

What You'll Be Doing

  • On-site embedded evaluators: spending weeks or months embedded at frontier AI labs conducting interviews, reviewing and gathering evidence, writing reports, and executing a playbook under high pressure.
  • Applied researchers: preparing and supporting on-site evaluators, developing conceptual frameworks and tooling for embedded evaluation, connecting fundamental research to on-site activities, and converting research methodologies into practical procedures.
  • Both roles involve quick execution, strong planning and research skills, and ownership of ambitious projects under tight deadlines.

Perks and Benefits

  • Market-competitive salary ranges depending on position and experience (Lead or IC roles).
  • Equity and comprehensive benefits including health, dental, and vision insurance.
  • Unlimited vacation and sick leave.
  • Up to 6 months paid parental leave.
  • Retirement savings plans with competitive employer matching.
  • Provided lunch, dinner, and snacks on workdays.
  • Paid work trips including retreats, business travel, and conferences.
  • $1,000 yearly professional development budget.
  • Relocation support and visa sponsorship for UK and US as applicable.
AI Summary ✨

Similar jobs

  • Research Scientist/Engineer (Fundamental Science)

    Apollo ResearchLondon, UK2 days ago
    NewVisa sponsor
  • Research Engineer, Multi-Agent Learning, DeepMind

    GoogleLondon, UK2 days ago
    NewRegistered sponsor
  • See all jobs in UK →