Requirements

4 or more years of software development and technical operations experience, with a focus on delivering high-scale data processing solutions in a production environment
Proven expertise in big data processing field with Apache Spark and other compute platforms and frameworks
Good understanding of table formats, schema evolution, and advanced data modeling
Hands-on experience with performance optimization, large-scale cluster tuning, and efficient big data architectures
Solid programming skills in Scala/Java or Python, with the ability to engineer robust, maintainable pipelines
Validated ability to research and become proficient in new emergent technologies, with an emphasis on leveraging AI coding agents
Validated experience implementing observability best practices—monitoring, logging, and tracing—across distributed data systems
A problem-solving approach, capable of diagnosing root causes and delivering solutions for complex data challenges
Commitment to the highest levels of quality, puts focus both in testing and code development
MUST possess a BS/MS in Computer Science or equivalent experience
Excellent communication skills (verbal and written) are critical to the role
Very good English language knowledge, written and spoken
Able to work efficiently across various time zones to coordinate with colleagues in different regions

Bonus skills

Experience with Big Data technologies, i.e. Hadoop/HBase/MapReduce/Iceberg/DeltaLake/Kafka, Databricks it's a plus
Experience in working with infrastructure, i.e. cloud providers, containers, Kubernetes, VM/Bare metal deployments, is a plus

Be engaged in all the product development and delivery stages, as part of an agile engineering team
Play an important role in shaping the technical direction of our service(s)
Deliver automation to prevent problem recurrence and automate responses to all non-exceptional service conditions
Scale our product services using traditional software engineering guidelines
Contribute to and promote good software engineering practices across the team, maintaining high standards
Collaborate with various internal teams and external partners to provide a high-quality customer experience
Work in an environment that supports individual growth and continuous learning
Perform on-call activities, on follow the Sun rotation with the rest of the team
Possibility to contribute to Open Source projects
Continually evaluate and adopt the latest industry technologies to optimize costs and increase efficiency
Participate fully in a culture that supports innovation and creativity while delivering high output in a predictable and reliable way