Research Engineer, Science of Scaling

About Anthropic

• Anthropic’s mission is to create reliable, interpretable, and steerable AI systems.
• We want AI to be safe and beneficial for our users and for society as a whole.
• Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the role

• Anthropic is seeking a Research Engineer/Scientist to join the Science of Scaling team.
• You will work at the intersection of cutting-edge research and practical engineering.

Responsibilities:

• Conduct research into the science of converting compute into intelligence.
• Independently lead small research projects while collaborating with team members on larger initiatives.
• Design, run, and analyze scientific experiments to advance our understanding of large language models.
• Optimize training infrastructure to improve efficiency and reliability.
• Develop dev tooling to enhance team productivity.

You may be a good fit if you:

• Have significant software engineering experience and a proven track record of building complex systems.
• Hold an advanced degree (MS or PhD) in Computer Science, Machine Learning, or a related field.
• Are proficient in Python and experienced with deep learning frameworks.
• Are results-oriented with a bias towards flexibility and impact.
• Enjoy pair programming and collaborative work.
• View research and engineering as two sides of the same coin.
• Care about the societal impacts of your work and have ambitious goals for AI safety and general progress.

Strong candidates may have:

• Experience with JAX.
• Experience with reinforcement learning.
• Experience working on high-performance, large-scale ML systems.
• Familiarity with accelerators, Kubernetes, and OS internals.
• Experience with language modeling using transformer architectures.
• Background in large-scale ETL processes.
• Experience with distributed training at scale (thousands of accelerators).

Strong candidates need not have:

• Experience in all of the above areas.
• Prior work specifically on language models or transformers.
• An advanced degree.

Perks and benefits:

• Competitive compensation and benefits.
• Optional equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours.
• Lovely office space in which to collaborate with colleagues.