Senior Research Engineer (Code World Models)

Requirements:

• Hands-on experience with model pre-training, continued training, or mid-training.
• Strong engineering skills in Python and experience with modern ML frameworks.
• Understanding of large-scale ML training workflows, including data processing and evaluation.
• Experience working with large datasets and caring about data quality.
• Background in NLP, ML for software engineering, or similar domain.
• Enjoy working on research problems with high uncertainty.

Nice to haves:

• Experience training or adapting models for code generation, understanding, repair, etc.
• Knowledge of execution-based data like unit tests, traces, logs, etc.
• Experience with large-scale distributed training of models.
• Understanding of evaluation challenges for code models.
• Contributions to ML infrastructure, open-source projects, or research systems.

What you'll be doing:

• Designing and running pre-training, continued pre-training, and mid-training experiments for code models.
• Building and improving data pipelines for large-scale model training.
• Working with code corpora, repositories, tests, execution traces, and synthetic data.
• Developing evaluations for complex repository-level code reasoning tasks.
• Collaborating with researchers and engineers working on ML for code and AI developer tools.

Perks and benefits:

• Equal opportunity employer with an open and inclusive workplace.
• Welcoming environment regardless of background, identity, religion, age, or orientation.
• Processing job application data in accordance with the Recruitment Privacy Policy.