Research Engineer, Pretraining

Requirements:

• Advanced degree (MS or PhD) in Computer Science, Machine Learning, or a related field

• Strong software engineering skills with a proven track record of building complex systems

• Expertise in Python and experience with deep learning frameworks (PyTorch preferred)

• Familiarity with large-scale machine learning, particularly in the context of language models

• Ability to balance research goals with practical engineering constraints

• Strong problem-solving skills and a results-oriented mindset

• Excellent communication skills and ability to work in a collaborative environment

• Care about the societal impacts of your work

Nice to Haves:

• Work on high-performance, large-scale ML systems

• Familiarity with GPUs, Kubernetes, and OS internals

• Experience with language modeling using transformer architectures

• Knowledge of reinforcement learning techniques

• Background in large-scale ETL processes

What You'll Be Doing:

• Conduct research and implement solutions in various areas

• Independently lead small research projects while collaborating with team members

• Design, run, and analyze scientific experiments related to large language models

• Optimize and scale training infrastructure

• Develop and improve dev tooling to enhance team productivity

• Contribute to the entire stack, from low-level optimizations to high-level model design

Perks and Benefits:

• Competitive compensation and benefits

• Optional equity donation matching

• Generous vacation and parental leave

• Flexible working hours

• Lovely office space in which to collaborate with colleagues