Software Development Engineer - Data Platform

Requirements

• A successful track-record or demonstrated aptitude as an engineer who has worked on distributed systems
• Experienced Poweruser of Apache Spark or Committer to Apache Spark
• BS or MS degree in computer science or equivalent professional experience

Preferred Qualifications

• Knowledge of Spark accelerators, e.g. Velox/Gluton or Datafusion/Comet
• Experience working on or building connectors from Spark to any of the data sources
• Knowledge of Yarn, Kubernetes or other compute substrate

What You'll Be Doing

• Develop and deploy new features of Apple’s internal data platform
• Regularly contribute to open source
• Collaborate with cross-functional teams to design and implement automation tools that streamline operations and reduce manual intervention
• Optimize our cloud-based services to ensure they scale effectively, handling increasing loads while maintaining high performance
• Innovate on API development and integration, enabling seamless communication between our applications and services