Senior Data Scheduling Infra Developer

Requirements:

• Bachelor's degree in Computer Science, Information Technology, or related field. Advanced degree preferred.
• 5+ years of experience in software development, with a strong focus on Python.
• 2+ years of hands-on experience with Apache Airflow, including DAG and Operator development.
• Strong understanding of cloud platforms and containerization technologies (Docker, Kubernetes).
• Experience with CI/CD tools and practices.
• Excellent problem-solving skills and ability to work independently on complex technical challenges.
• Strong communication skills and ability to work collaboratively in a global team environment.

Nice to Haves:

• Deep understanding of Apache Airflow architecture and internals, with proven experience in customizing its source code.
• Experience as a contributor or committer to the Apache Airflow project or similar open-source projects.
• Excellent communication skills and ability to collaborate effectively with both internal teams and the open-source community.
• Experience with big data technologies such as Hadoop, Spark, Kafka, Flink.

What You'll Be Doing:

• Analyze, customize, and enhance Apache Airflow's source code to develop new features and improve existing functionalities and performance.
• Collaborate with the Apache Airflow community to contribute patches, propose enhancements, and resolve issues.
• Implement best practices for Airflow architecture, including security, scalability, and performance optimization.
• Develop and optimize complex Airflow DAGs and Operators for data processing and orchestration.
• Stay updated with the latest trends and advancements in Airflow and related technologies.

Perks and Benefits:

• Opportunity to work with a team of passionate thinkers, innovators, and dreamers.
• Contribute to building communities and creating economic opportunity for all.