Senior Data Engineer - Agents Systems

Requirements

• 5+ years in data engineering with at least 2 years focused on streaming systems in production
• Hands-on experience with RisingWave, Apache Flink, Kafka Streams, or comparable stream processing frameworks
• Strong understanding of feature store design — online/offline consistency, point-in-time correctness, low-latency serving
• Experience building data pipelines that feed production ML models or inference systems
• Proficiency in Python and/or Scala; SQL fluency required
• Familiarity with data quality frameworks, pipeline observability, and SLA ownership
• Comfortable operating in a fast-moving, ambiguous environment embedded within an AI-focused team

Nice to Haves

• Direct experience with RisingWave in production
• Exposure to inference pipeline architecture or model serving infrastructure
• Experience with feature platforms
• Crypto or fintech domain experience

What You'll Be Doing

• Own and evolve streaming data pipelines that power live inference and real-time model serving across Kraken's AI infrastructure
• Design and build feature stores that serve low-latency, high-reliability features to production ML models
• Implement and maintain streaming systems using RisingWave, Apache Flink, or Kafka Streams, selecting the right tool for the workload
• Partner with ML engineers and AI infra teams to define data contracts, feature schemas, and pipeline SLAs
• Drive pipelines toward real-time where batch exists today reducing latency from hours to seconds
• Ensure data quality, observability, and auditability across all streaming and feature engineering systems
• Contribute to inference pipeline tooling where data engineering and model serving intersect
• Evaluate emerging streaming and feature store technologies and shape the team's technical roadmap

Perks and Benefits

• Global financial infrastructure platform advancement
• Opportunity to work with cutting-edge technologies in the AI and data engineering space
• Cross-functional collaboration with product, infrastructure, and internal operations teams
• Fast-moving and pragmatic work environment with a focus on innovation
• Celebration of diverse talents and perspectives within the team