Distributed Systems Engineer - Data Platform - Logs and Audit Logs

Requirements

• 3+ years of experience working in software development covering distributed systems and data pipelines.
• Strong programming skills (Go is preferable), with a deep understanding of software development best practices for building resilient, high-throughput systems.
• Hands-on experience with modern observability stacks, including Prometheus, Grafana, and a strong understanding of handling high-cardinality metrics at scale.
• Strong knowledge of SQL, including experience with query optimization.
• A solid foundation in computer science, including algorithms, data structures, distributed systems, and concurrency.
• Strong analytical and problem-solving skills.
• Ability to work collaboratively in a team environment and communicate effectively with other teams across Cloudflare.

Nice to Haves

• Experience with data streaming technologies (e.g., Kafka, Flink) is a strong plus.
• Experience with various logging platforms or SIEMs (e.g., Splunk, Datadog, Sumo Logic) and storage destinations (e.g., S3, R2, GCS) is a plus.
• Experience with Infrastructure as Code tools like SALT or Terraform is a plus.
• Experience with Linux container technologies, such as Docker and Kubernetes, is a plus.

What You'll Be Doing

• Design, build, and operate a robust logging platform, ensuring reliable logging and secure data transfer to a wide array of customer destinations and third-party integrations.
• Develop and maintain high-performance data connectors and integrations for log-shipping products, focusing on usability, scalability, and data integrity.
• Create and manage systems for handling comprehensive audit logs, ensuring secure delivery and compliance with performance standards.
• Scale and optimize the data delivery pipeline to handle massive data volumes with low latency.
• Work closely with Product and other engineering teams to define requirements for a new logging platform and integrations.
• Maintain the operational health of the log delivery platform through monitoring and participation in an on-call rotation.
• Collaborate on the architectural evolution of the data egress platform, researching and implementing new technologies.

Perks and Benefits

• We’re not just a highly ambitious, large-scale technology company. We’re a highly ambitious, large-scale technology company with a soul.
• Access to cutting-edge technologies and working with a world-class team of engineers.
• Opportunity to contribute to projects like Project Galileo and the Athenian Project, protecting the free and open internet.
• Equal opportunity employer committed to diversity and inclusiveness.
• Reasonable accommodations provided to qualified individuals with disabilities.