Software Engineer III, Infrastructure, Conduit Flume Pipelines

Requirements

• Bachelor’s degree or equivalent practical experience.
• 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
• 2 years of experience with data structures or algorithms.
• 2 years of experience with developing infrastructure, distributed systems or networks, or with compute technologies, storage or hardware architecture.
• Experience developing software applications using the C++ programming language.
• Experience with object-oriented programming, templates, and the Standard Template Library (STL).

Nice to have

• Experience in operating and managing flume pipelines.
• Experience with ML data processing workflows.

What You'll Be Doing

• Build components of a managed system that handles deployment, scheduling, launching, monitoring and debugging of Flume jobs.
• Deliver new features to expand the set of use cases that Conduit Flume Pipelines (CFP) can serve, including support for data processing for Machine Learning (ML).
• Build core orchestration libraries in C++, define and extend public Application Programming Interface (APIs) in C++, Python, Java and Go.
• Work with the underlying infrastructure teams (e.g., Conduit, Flume, Data Engineering Console, Table Service) to integrate with their APIs, define requirements for new features and make code contributions to their codebases.
• Make smaller contributions to Dreampipe to continue supporting the most important new use cases.

Perks and Benefits

• Google is an equal opportunity and affirmative action employer.
• Opportunity to work on cutting-edge technologies at a global company.
• Potential to switch teams and projects for personal growth.