Software Engineer - Big Data (Compute/Data Distiller), Adobe Experience Platform

What You'll Be Doing

  • Design, build and operate complex features in a large-scale, multi-cloud, microservices-based SaaS product.
  • Lead application, framework and service design efforts, optimizing for quality, testability, scalability and performance.
  • Work on query execution, Spark SQL, query optimization, and orchestration of compute workloads across multiple engines and clouds.
  • Prototype new approaches and deliver production solutions at scale; research new technologies and keep up with industry trends.
  • Partner with Product Management, Design, Data Science and engineering teams across domains including US counterparts.
  • Provide guidance in architecture, design and code reviews; mentor teammates and promote good engineering practices and continuous learning.
  • Participate in on-call activities on a follow-the-sun rotation with the team.
  • Contribute to open-source projects where relevant.

Requirements

  • B.S. in Computer Science or equivalent engineering degree, and/or 3+ years of relevant experience building software systems.
  • Strong programming skills in Java and/or Scala, with solid grasp of OOP, functional programming and design patterns.
  • Proven expertise with distributed data processing: Apache Spark (including Spark SQL), Databricks, Delta Lake or equivalent Lakehouse technologies.
  • Good understanding of SQL, query engines and query optimization, table formats and schema evolution.
  • Hands-on experience with performance optimization, large-scale cluster tuning and efficient big data architectures.
  • Experience building scalable, resilient backend services and REST APIs.
  • Experience with cloud platforms (AWS and/or Azure).
  • Demonstrated experience delivering and operating a high-quality SaaS solution including testing, CI/CD, monitoring, infrastructure as code.
  • Experience implementing observability best practices (monitoring, logging, tracing) in distributed systems.
  • Ability to quickly learn new technologies, with emphasis on AI coding agents and agentic ecosystem to boost productivity.
  • Problem-solving mindset with ability to diagnose root causes, and attention to security and performance issues.
  • Commitment to quality in both code and testing.
  • Very good written and verbal communication skills in English.

Nice to Have

  • Experience with Kubernetes, Docker and infrastructure tooling (Terraform, ArgoCD).
  • Experience with multiple compute engines or orchestration frameworks (e.g. Ray/Anyscale, Flink, YARN).
  • Python skills and experience building LLM-based agents or tools.
  • Experience with Kafka, NoSQL databases (e.g. Cassandra, HBase) or Iceberg.
  • Familiarity with PostgreSQL / JDBC protocols or BI tool integrations.
  • Familiarity with monitoring tools such as Splunk, Prometheus, Grafana or New Relic.
  • Experience with Agile / Scrum methodologies.

Perks and Benefits

  • Opportunity to solve hard distributed-systems problems at petabyte scale for some of the world’s largest brands.
  • Work with cutting-edge technologies including Spark, Databricks, Delta Lake, Ray and AI agents.
  • Have direct impact on the whole Adobe ecosystem as AEP powers Adobe’s products.
  • Join a growing team with a shared global roadmap and participate in a follow-the-sun on-call model.
AI Summary ✨

Similar jobs

  • Backend Engineer, Blockchain Data Team

    PhantomRemote EMEAa year ago
    Still lookingRemote EMEA
  • See all jobs in Romania →