Software Engineer - Lakehouse and AI Data Platform - Warsaw - Analyst/Associate

Requirements

  • Bachelor’s or master’s degree in a relevant discipline, or equivalent practical experience, with strong quantitative skills or data engineering expertise.
  • Strong hands-on programming experience in Python or Java.
  • Good working knowledge of SQL including troubleshooting, optimisation and data analysis.
  • Ability to learn new tools, internal platforms and delivery workflows quickly.
  • Familiarity with software engineering fundamentals such as version control, testing, release discipline and CI/CD practices.
  • Understanding of temporal data modelling, handling historical state and change over time.
  • Knowledge of schema design, schema evolution and data compatibility.
  • Understanding of partitioning, clustering, and other techniques to improve data performance at scale.
  • Ability to make design choices between normalized and denormalized models and between natural and surrogate keys.
  • Practical approach to data quality, reconciliation and root-cause analysis.
  • Experience building or supporting production data pipelines in a collaborative engineering environment.
  • Experience with distributed data processing frameworks such as Apache Spark.
  • Working knowledge of common data formats such as JSON, Avro, and Parquet.

What You'll Be Doing

  • Design, build, test and support data pipelines and curated datasets on the firm’s modern data platform.
  • Build, enhance and support batch and streaming data pipelines on the Lakehouse and AI data platform.
  • Refactor or modernize existing data flows to improve reliability, performance and maintainability.
  • Ensure data pipelines are production-ready, well tested and operationally supportable.
  • Develop raw, refined and curated datasets that support analytics, reporting and AI use cases.
  • Apply sound data modelling principles to represent business entities, relationships and historical change accurately.
  • Collaborate with consumers to shape usable, well-documented data products aligned to business needs.
  • Implement controls to validate completeness, accuracy and consistency of data across pipelines and datasets.
  • Use reconciliation methods to build confidence in production outputs and investigate issues.
  • Contribute to standards for testing, monitoring and issue resolution.
  • Work closely with engineers, platform teams and data consumers to deliver outcomes on time and with quality.
  • Communicate clearly on progress, risks, dependencies and design choices.

Nice to Haves

  • Experience with modern and evolving data stacks including ANSI SQL, Apache Spark, Kafka.
  • Familiarity with platforms and storage technologies such as Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, Sybase IQ.
  • Experience with CI/CD tooling and containerized or Kubernetes-based deployment approaches.
  • Sound judgement in technical trade-offs and strong attention to detail in data correctness and testing.
  • Clear and structured approach to problem solving.
  • Willingness to work closely with stakeholders and partner teams.
  • Interest in developing long-term expertise within the firm.
AI Summary ✨

Similar jobs

  • Analytics Engineer

    ElevenLabsUKPoland10 days ago
    RemoteRegistered sponsor
  • Big Data Engineer (Scala)

    BoxPoland18 days ago
  • Senior Member of Technical Staff, Web Data

    CohereLondon, UK24 days ago
    Remote EMEARegistered sponsor
  • See all jobs in Poland →