Software Engineer, Data

Requirements

• Minimum 5 years of industry experience, including a Software Engineering background and a strong data engineering/data platform experience
• Proficient in Python, SQL, and experience with big data technologies (e.g., Hadoop, Spark, Hive)
• Familiarity with data warehousing solutions (e.g., Redshift, BigQuery, Snowflake)
• Experience with real-time data processing and streaming platforms (e.g., Kafka, Flink)
• Experience with large-scale distributed systems
• Knowledge of databases, caching mechanisms, and messaging systems
• Strong problem-solving abilities and attention to detail
• Ownership and capacity to ship products end-to-end
• Excellent communication skills
• Low ego and team spirit mindset
• Autonomous and a self-starter

What you'll be doing

• Product Development: design, develop, and maintain scalable data pipelines and ETL processes
• System Architecture: design and implement efficient, secure, and scalable backend architectures that support our product goals
• Code Quality: write clean, maintainable, and well-documented code, and participate in code reviews to uphold our high standards of quality
• Collaboration:
  • Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions
  • Support our AI scientists to help them access data to improve our Large language models' accuracy and performance
  • Contribute to the development of data governance policies and procedures
• Problem-Solving:
  • Ensure data integrity, quality, and security across all data platforms
  • Develop and implement data warehousing and data lake solutions
  • Optimize data queries and improve data processing performance. Monitor and troubleshoot data-related issues and incidents