Research Engineer / Research Scientist, Pre-training

Requirements

• Degree (BA required, MS or PhD preferred) in Computer Science, Machine Learning, or a related field

• Strong software engineering skills with a proven track record of building complex systems

• Expertise in Python and deep learning frameworks

• Have worked on high-performance, large-scale ML systems, particularly in the context of language modeling

• Familiarity with ML Accelerators, Kubernetes, and large-scale data processing

• Strong problem-solving skills and a results-oriented mindset

• Excellent communication skills and ability to work in a collaborative environment

Nice to Haves

• Significant software engineering experience

• Ability to balance research goals with practical engineering constraints

• Willingness to take on tasks outside your job description to support the team

• Enjoy pair programming and collaborative work

• Desire to learn more about machine learning research

• Enthusiasm for working at an organization pursuing large-scale AI research projects

• Ambitious goals for AI safety and general progress

What You'll Be Doing

• Conduct research and implement solutions in areas such as model architecture, algorithms, data processing, and optimizer development

• Independently lead small research projects while collaborating with team members on larger initiatives

• Design, run, and analyze scientific experiments to advance understanding of large language models

• Optimize and scale training infrastructure to improve efficiency and reliability

• Develop and improve dev tooling to enhance team productivity

• Contribute to the entire stack, from low-level optimizations to high-level model design

Perks and Benefits

• Competitive compensation and benefits

• Optional equity donation matching

• Generous vacation and parental leave

• Flexible working hours

• Lovely office space for collaboration