Senior Data Engineer

Requirements

• 5+ years of experience building production-grade data platforms or large-scale data processing systems
• Strong Python software engineering experience
• Hands-on experience with Apache Airflow or similar workflow orchestration platforms
• Experience with AWS services including S3, EC2, AWS Batch, IAM, CloudWatch, and cloud SDKs
• Strong understanding of data quality, validation, testing, monitoring, and observability
• Good understanding of distributed data processing concepts
• Strong Linux skills and experience developing and supporting production systems
• Excellent problem-solving skills with the ability to collaborate effectively across research, engineering, and infrastructure teams

Nice to Have

• Experience working with market or financial data
• Knowledge of non-equity asset classes (e.g. futures, fixed income, commodities, FX)
• C++ development experience
• SQL proficiency
• Experience with Docker, Kubernetes, and Infrastructure-as-Code (Terraform or CloudFormation)
• Familiarity with Apache Parquet, Apache Arrow, or distributed processing frameworks such as Spark, Ray, or Dask

What You'll Be Doing

• Design, build, and operate the data platform powering quantitative research and backtesting
• Develop production-grade Python applications to acquire, process, validate, and distribute market and reference data
• Build and operate scalable, automated data pipelines using technologies such as Apache Airflow and AWS Batch across AWS and QRT's compute infrastructure
• Ensure data quality, validation, reconciliation, and observability across critical production pipelines
• Design systems that efficiently process large-scale datasets while supporting compute-intensive research workloads
• Collaborate closely with quantitative researchers, software engineers, and infrastructure teams to accelerate dataset onboarding and improve research productivity
• Drive engineering best practices with a strong focus on software quality, automation, scalability, and operational excellence

Perks and Benefits

• Equal opportunity employer
• Diversity welcomed as essential to success
• Initiatives and programs to enable employees to achieve a healthy work-life balance