Software Engineer (Scheduler), London

Requirements

  • Practical experience building or operating cluster schedulers, batch systems, or queuing frameworks (e.g., Kueue, Volcano, Slurm)
  • Deep, hands-on Kubernetes experience including writing and maintaining custom Kubernetes controllers, operators, and interacting with cluster orchestration APIs
  • Strong practical experience with cloud providers focusing on compute provisioning, networking, and Infrastructure as Code
  • Solid foundation in DevOps/SRE best practices with adaptability to AI accelerator infrastructure
  • Strong programming skills, high proficiency in Python or Go

Nice to Haves

  • Experience operating Kueue
  • Familiarity with ML infrastructure nuances, such as Nvidia GPUs, Google TPUs, gang scheduling, or collective networking
  • Previous experience in High-Performance Computing or maximizing utilization with fixed/committed hardware constraints
  • Familiarity with GCP cloud compute infrastructure and Infrastructure as Code
  • Background in ML software engineering or infrastructure SRE supporting machine learning research

What You'll Be Doing

  • Design, operate, and extend ML workload scheduling systems for dynamic batch inference and long-running training workloads
  • Implement scheduling policies like gang scheduling, topology-aware placement, and preemption to optimize compute utilization across GPU and TPU fleets
  • Collaborate with ML researchers and infrastructure teams to understand workload behavior, troubleshoot bottlenecks, and develop platform capabilities
  • Build systems with clear failure semantics and maintain high availability through robust processes, runbooks, and SLOs
  • Develop and maintain custom Kubernetes controllers, operators, and CRDs tailored to ML pipeline orchestration needs

Perks and Benefits

  • Join an interdisciplinary team driving groundbreaking AI innovation in drug discovery to solve disease
  • Be part of a collaborative, thoughtful, brave, determined, and inclusive culture
  • Work in a hybrid environment requiring office presence three days a week, promoting knowledge sharing and strong relationships
  • Support for equal employment opportunity and accommodation for disabilities or additional needs
AI Summary ✨

Similar jobs

  • Cloud Observability Platform Engineer (Contractor)

    QRTLondon, UK2 days ago
    Registered sponsor
  • Senior Software Engineer I - Platform - Cloud Foundations

    WiseGreater London, UK3 days ago
    Registered sponsor
    ≈ €105k – €133k / year base
  • See all jobs in UK →