Staff Backend Engineer, Datalake Platform

Requirements

  • 10+ years of professional software engineering experience
  • Demonstrated track record of designing, building, and operating large-scale distributed storage or data infrastructure systems
  • Deep experience with object storage (S3, Azure Blob, or equivalent) — including IAM, access control policy design, lifecycle management, and operational practices at petabyte scale
  • Proven ability to lead complex, multi-quarter infrastructure projects end-to-end, including cross-team dependency management and coordinating migrations across many consuming teams
  • Strong background in authorization and access control design for distributed data systems

Nice to Haves

  • 5+ years of Backend/Infrastructure Software Engineering experience
  • Experience safely executing large-scale data migrations with a strong instinct for sequencing, blast radius reduction, rollback, and data integrity validation
  • A strong developer experience sensibility: the ability to build abstractions that are ergonomic, well-documented, and actively reduce toil for the engineering teams that depend on your platform

What You'll Be Doing

  • Architect the unified Iceberg platform: Lead the technical design of a metastore service as it becomes the single source of truth for Iceberg table management across all compute engines — Spark, Trino, Flink, and PyIceberg
  • Lead compliance architecture: Partner with security and compliance teams to translate regulatory requirements into durable preventative technical controls — audit logging, access review infrastructure, data segregation, and lifecycle enforcement — built into the platform rather than bolted on
  • Drive cost and efficiency at petabyte scale: Identify systemic inefficiencies in storage layout, snapshot retention, and data lifecycle, and design automated, self-service tooling that scales without ongoing manual intervention from the team
  • Set the technical bar: Own critical design reviews, establish standards for reliability, security, and developer experience, and mentor senior engineers through high-stakes architectural decisions

Perks and Benefits

  • Foundational infrastructure with broad reach at Stripe
  • Multi-cloud architecture design and transition opportunities
  • Active, high-stakes, OSS-aligned architectural transformation projects
  • Opportunity to influence technical strategy and the roadmap
AI Summary ✨

Similar jobs

  • Kernel / Hypervisor Engineer, Firecracker

    AWSDublin, Irelanda day ago
    NewRegistered sponsor
  • Kernel / Hypervisor Engineer, Firecracker

    AWSDublin, Irelanda day ago
    NewRegistered sponsor
  • Kernel / Hypervisor Engineer, Firecracker

    AWSDublin, Irelanda day ago
    NewRegistered sponsor
  • Software Development Engineer (open-source), Runtimes

    AWSDublin, Irelanda day ago
    NewRegistered sponsor
  • See all jobs in Ireland →