Member of Engineering (Inference Infrastructure)

Requirements

  • Strong programming skills in Go, or other similar languages
  • Strong systems engineering background: distributed systems, schedulers, control planes, or high-throughput data planes
  • Production experience with Kubernetes internals — controllers, informers, operators — not just deploying to it
  • Bias toward observability and debuggability: building a system that is easy to navigate when debugging production issues
  • Experience in systems serving large scale inference requests (preferred)

What You'll Be Doing

  • Design and develop internal scheduling system to maximize GPU utilization
  • Build API and tooling to help manage the lifecycle of GPU workloads and troubleshoot failures
  • Design and improve inference control plane to speed up model deployment and inference request serving
  • Collaborate with research to improve research velocity continuously

Perks and Benefits

  • Fully remote work & flexible hours
  • 37 days/year of vacation & holidays
  • Health insurance allowance for you & dependents
  • 16 weeks of flexible, full-pay parental leave
  • Well-being, always-be-learning & home office allowances
  • Company-provided equipment
  • Frequent team get togethers
  • Diverse & inclusive people-first culture
AI Summary ✨

Similar jobs

  • 6 days agoRemote EMEA
  • 6 days agoRemote EMEA
  • 6 days agoRemote EMEA
  • 6 days agoRemote EMEA
  • See all jobs in undefined →