Staff Engineer, Data Platform

What you'll be doing

  • Contribute to and uphold the overall vision for DRW’s Data Platform, guiding its architecture and evolution to advance the firm’s data strategy.
  • Work with engineering leads, product managers, and stakeholders to understand business priorities and translate data strategy into engineering products, platform capabilities, and contribute to the sequenced technical roadmap.
  • Design, guide, and build managed platform services for data storage, distributed query execution, batch and streaming processing, and workload orchestration, owning their lifecycle including provisioning, upgrades, and production support.
  • Lead delivery across team boundaries, turning ambiguous requirements into practical designs and measurable outcomes while balancing immediate business needs with long-term platform goals.
  • Drive architecture reviews and technology decisions, documenting trade-offs and building consensus around patterns that uphold the platform vision across the data ecosystem.
  • Own the strategy for large-scale data governance and build platform capabilities for metadata management, discovery, lineage, schema evolution, and data quality in partnership with security and data stakeholders.
  • Troubleshoot distributed systems, contribute to production support and incident response, and drive lasting improvements via root-cause analysis, automation, and operational documentation.
  • Mentor engineers across teams through design reviews, code reviews, and hands-on collaboration, strengthening engineering practices and encouraging ownership of complex systems.

Requirements

  • Extensive experience designing, building, and operating large-scale, data-intensive distributed systems, including technical leadership of multi-team initiatives.
  • Experience coordinating with engineering leadership to accelerate team- and organization-wide delivery within existing processes and practices.
  • Proven track record of translating data or business strategy into engineering products and technical roadmaps, aligning near-term delivery with long-term platform vision.
  • Track record of building and offering managed platform services to other teams, managing provisioning, upgrades, reliability, and support with direct user interaction for requirements and feedback.
  • Experience scaling metadata management systems like data catalogs or lineage tracking systems spanning multiple storage and compute technologies.
  • Expertise in Java and/or Python with proven ability to deliver high-quality, maintainable production software; strong familiarity with SQL and Linux environments.
  • Deep understanding of distributed systems trade-offs, including consistency, fault tolerance, concurrency, partitioning, and recovery from partial failures.
  • Production experience building batch and stream processing systems at scale, with practical knowledge of state management, replay, backpressure, and delivery guarantees.
  • Experience deploying data processing and query technologies such as Flink, Spark, and ClickHouse, with ability to guide platform users on performance and operational trade-offs.
  • Experience with multiple storage technologies including object storage, relational or NoSQL databases, and event streaming systems such as Kafka; deep knowledge of open table formats like Iceberg or Delta Lake.
  • Extensive experience with data modeling, schema governance, evolution, and serialization formats such as Arrow, Parquet, Protobuf, or Avro.
  • Familiarity with building and operating cloud-native data infrastructure, including Kubernetes, workflow orchestration, automated deployment, and production monitoring.
  • Excellent written and verbal communication skills to communicate technical visions, explain trade-offs, align stakeholders, and lead across a globally distributed organization.
  • Strong technical judgment and problem-solving skills to prioritize competing needs, deliver incrementally in a fast-paced trading environment, and develop other engineers.

Nice to haves

  • Experience scaling managed data services across teams with differing workloads, service expectations, and operational constraints.
  • Hands-on knowledge of data governance in regulated environments.
  • Familiarity with financial datasets and the needs of trading, quantitative research, or back-office users.

Perks and benefits

  • Annual base salary range of $200,000 to $275,000 depending on experience and qualifications.
  • Eligibility for an annual discretionary bonus.
  • Comprehensive suite of employee benefits including group medical, pharmacy, dental and vision insurance.
  • 401k plan with discretionary employer match.
  • Short and long-term disability, life and AD&D insurance.
  • Health savings accounts and flexible spending accounts.
AI Summary ✨

Similar jobs

  • Senior Data Engineer, Unified Platform

    DRWLondon, UK2 days ago
    NewRegistered sponsor
  • Senior Data and Cloud Engineer, AI for Science

    MicrosoftGermanyNetherlandsUK2 days ago
    NewRegistered sponsor
    ≈ €78.8k – €152.5k / year base3 countries
  • Senior Data Engineer I - Global KYC & Onboarding

    WiseGreater London, UK2 days ago
    NewRegistered sponsor
    ≈ €105k – €133k / year base
  • See all jobs in UK →