Requirements

• Develop, optimize, and productionize machine learning models for Cloudflare’s serverless inference platform, with a focus on performance, reliability, and model quality.
• Build benchmarking and evaluation frameworks to measure latency, throughput, cost efficiency, and model behavior across LLMs, speech, vision, and other model families.
• Improve inference performance through quantization, batching, caching, model compilation, runtime tuning, and accelerator-aware optimization.
• Partner with systems engineers to integrate models into Cloudflare’s distributed inference infrastructure across a heterogeneous fleet of GPUs and next-generation accelerators.
• Drive improvements to model deployment workflows, including validation, rollout safety, observability, regression testing, and operational readiness.
• Collaborate with product and engineering teams to translate customer requirements into scalable ML capabilities for Workers AI.
• Mentor engineers, contribute to technical direction, and raise the quality bar for production ML engineering practices across the team.

Nice to Haves

• Experience contributing to open source ML tooling, model serving frameworks, or inference runtimes.

What You'll Be Doing

• Define how machine learning models run across Cloudflare’s global network.
• Work with systems engineers, product teams, hardware partners, and AI/ML engineers to bring models into production with low latency, strong reliability, and efficient resource use.
• Combine applied ML, inference optimization, evaluation, and production engineering.
• Focused on benchmarking models, improving serving performance, validating quality, and building tooling to ship AI applications at Internet scale.

Perks and Benefits

• Cloudflare is an equal opportunity employer committed to diversity and inclusiveness.
• Provides reasonable accommodations to qualified individuals with disabilities.
• A highly ambitious, large-scale technology company with a soul, focused on protecting the free and open Internet.
• Named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company.