Research Engineer, RL Scaling Science

Requirements

  • Strong empirical research skills in Reinforcement Learning, large-scale ML training, or a closely adjacent area
  • Demonstrated ability to own large experiments end-to-end, from design through interpretation
  • Proficiency in Python and experience working with large-scale or distributed ML systems
  • Comfort operating at the research/systems boundary, including debugging where the two meet
  • Care about the societal impacts of AI and responsible scaling

Nice to Haves

  • Published or shipped work in long-horizon RL or RL fundamentals
  • Experience translating research findings into production training recipes
  • Demonstrated large scale industry impact via RL interventions
  • Experience working on frontier-scale training runs with long trajectories

What You'll Be Doing

  • Design, run, and interpret large-scale RL experiments, reasoning rigorously about what the data does and doesn't show
  • Investigate how RL improves as horizon, compute, and model size grow
  • Build and maintain benchmarks for long-horizon RL so progress is measurable and reproducible
  • Translate validated findings into production training recipes, exercising judgment about when a result is robust enough to ship
  • Debug complex issues at the seam where research meets infrastructure - failures that only appear at scale
  • Partner closely with adjacent RL teams across research and engineering and advance our overall RL stack

Perks and Benefits

  • Generous vacation and parental leave
  • Flexible working hours
  • Competitive compensation and benefits
  • Optional equity donation matching
  • Lovely office space in which to collaborate with colleagues
AI Summary ✨