Senior Data Engineer, Exposure

Requirements

• Experience in designing and implementing cloud-native, distributed data processing systems in a major cloud provider (AWS preferred).
• Deep expertise in Python and Apache Spark, with a strong understanding of performance tuning and distributed computing principles.
• A bias to ship and iterate alongside product management and design partners to turn raw data into actionable insights.
• A technical background with extensive experience working directly on backend systems and large-scale data architecture.
• Pride in materializing complex product ideas into stable, production-grade data pipelines.
• Exposure to or interest in the cryptocurrency technology ecosystem and the unique data challenges it presents.

Nice to Haves

• Mentored other engineers, leading cross-team data initiatives, and driving design and technology decisions is a plus.
• Worked with Terraform and Kubernetes (EKS) for orchestrating data workloads is a plus.
• A genuine excitement for significantly scaling large data systems and exploring the latest in "Modern Data Stack" technologies.

What You'll Be Doing

• Build cloud-native data ingest and aggregation processes that intake gigabytes of data per day.
• Develop and optimize high-performance Spark jobs in Python to detect activities for market manipulation, fraud, behavioral patterning, and more.
• Build and improve batch-based applications as well as real-time streaming pipelines processing billions of records per day.
• Architect and maintain scalable data lakehouse environments using formats like Parquet, Iceberg, and Delta Lake.
• Collaborate on building scalable API services on AWS that interface with our data layer to handle 1,000s of requests per second.
• Help the team modernize our data stack to operate at 10x current capacity, moving toward highly automated, serverless architectures.
• Debug production data quality issues and performance bottlenecks across distributed systems and microservices.

Perks and Benefits

• Opportunity to work on cutting-edge technology in the blockchain investigation and compliance industry.
• Global organization with diverse teams across different countries.
• Chance to solve challenging technical problems and work with exceptionally talented teammates.
• Flexible and scalable data platform to adapt to rapid industry changes.
• Promoting diversity and inclusion within the team and commitment to a diverse culture.