Sr. Software Engineer – Spark & AI/ML (Adobe Experience Platform)

Requirements

• A strong passion for computer science and data engineering, with a focus on delivering high-scale data processing solutions in a production environment
• Proven expertise in big data processing field: Spark, Delta Lake (or equivalent Lakehouse technologies)
• Good understanding of table formats, schema evolution, and advanced data modeling
• Hands-on experience with performance optimization, large-scale cluster tuning, and efficient big data architectures
• Solid programming skills in Scala and/or Java, with the ability to engineer robust, maintainable pipelines
• Validated ability to research and become proficient in new emergent technologies, with an emphasis on leveraging AI coding agents to enhance productivity
• Validated experience implementing observability best practices—monitoring, logging, and tracing—across distributed data systems
• A problem-solving mindset, capable of diagnosing root causes and delivering solutions for complex data challenges
• Commitment to the highest levels of quality, puts focus both in testing and code development
• Very good written and verbal communication skills
• Very good English language knowledge, written and spoken

Nice to Haves

• Experience with Big Data Lakehouse technologies like Hadoop, HBase, MapReduce, Iceberg, DeltaLake, Kafka, Databricks is a plus
• Spark knowledge is a huge plus
• Experience in working with infrastructure, e.g., cloud providers, containers, Kubernetes, VM/Bare metal deployments, is a plus

What You'll Be Doing

• Be involved in all the product development and delivery stages, as part of an agile engineering team
• Research various technologies useful for the project and keep in touch with the evolution of the industry
• Work in an environment that supports individual growth and continuous learning
• Contribute to and promote good software engineering practices across the team
• Provide guidance in architecture, design & code reviews
• Possibility to contribute to Open Source projects
• Perform on-call activities, on follow the Sun rotation with the rest of the team

Perks and Benefits

• Work on Adobe Experience Platform to drive real-time customer intelligence
• Solving complex challenges in a collaborative, fast-paced environment
• Opportunity to develop modern data architectures and Big Data/Lakehouse solutions
• Access to Equal Employment Opportunity and exceptional employee experiences