Data Engineer, Data Quality & Provenance

Requirements

  • Strong hands-on Python and SQL skills with solid production software-engineering fundamentals.
  • Experience designing and operating large-scale distributed data systems beyond small analytics or reporting pipelines.
  • Production experience with distributed-processing and workflow-orchestration technologies such as Spark, Flyte, or Airflow.
  • Experience building cloud-based data platforms using object storage and understanding of data organisation, versioning, querying, governance, and cost management.
  • Ownership of data quality, lineage, observability, reproducibility, and incident response for production data workflows.
  • Ability to translate ambiguous requirements from ML, data-science, robotics, or similarly technical teams into durable, reusable platform capabilities.
  • Comfort working in ambiguity and helping define standards and operating models for a growing data platform.

Nice to Haves

  • Experience with autonomous vehicles, ADAS, robotics, mapping, sensor-rich systems, geospatial data, or multimodal datasets.

What You'll Be Doing

  • Design and operate scalable batch and streaming pipelines for multimodal fleet and simulation data.
  • Build data models, catalogues, indexes, and query capabilities to make sensor, vehicle-state, map, and event data easy to discover and use.
  • Create versioned, reproducible datasets for training, evaluation, replay, scenario mining, and safety analysis.
  • Develop workflows for data ingestion, synchronisation, transformation, curation, labelling, and quality validation.
  • Partner with autonomy, ML, simulation, and safety engineers to define schemas, APIs, and data contracts.
  • Improve the reliability, performance, and cost efficiency of large-scale storage and compute workloads.
  • Work on petabyte-scale data products supporting autonomous-driving development across various technical teams.
  • Ensure trusted datasets with strong versioning, lineage, and reproducibility guarantees.
  • Develop metadata, geospatial, and temporal indexing enabling data discovery, selection, and scenario mining.
  • Combine real-world fleet logs with simulation and synthetic data for closed-loop development.
  • Establish data-quality standards, observability, access controls, retention policies, and incident-response processes.
  • Maintain cloud-based storage and distributed-compute infrastructure designed for reliability, scalability, and cost efficiency.

Perks and Benefits

  • Salaries benchmarked against the market annually.
  • Meaningful equity and sharing in the ownership and long-term success of the company.
  • Relocation support and visa sponsorship where applicable.
  • Hybrid working model with core hours and opportunities to work hands-on in vehicle workshops and labs.
  • Learning and development budgets supporting training, conferences, and growth.
  • Comprehensive benefits including health insurance, dental, enhanced maternity and paternity leave, retirement or pension plans (where applicable), access to therapists, wellbeing partnerships, and team socials.
AI Summary ✨

Similar jobs

  • Data Platform Engineer

    ClickHouse4 locations9 days ago
    RemoteRegistered sponsor
  • Senior Software Engineer, Real-Time Data Platform

    NVIDIAGermanya month ago
    €112.2k – €194.5k / year base
  • See all jobs in Germany →