Staff Software Engineer, AI Serving (AI Infrastructure)
AI Summary ✨
Requirements
A proven track record of directly contributing to and leading infrastructure projects at scale, ideally in serving, deployment, or platform engineering
The ability to work collaboratively with the team to solve problems, transfer knowledge, and develop overall platform architecture
The ability to work effectively across teams, driving technical initiatives spanning multiple groups within AI Infrastructure and beyond
Comfort with ambiguity: you can take on broad, cross-team problems and drive them to resolution without waiting for every detail to be specified
Coaching and mentorship experience
Nice to Have
Bonus: Python expertise. Experience with Python tooling, libraries, and developer experience is a strong plus, given the team's role in stewarding Python across AI workloads at HubSpot
What You'll Be Doing
Write and ship production code that directly powers AI capabilities across HubSpot, a crucial building block for user and business impact at scale
Lead the evolution of our model serving and inference infrastructure, improving reliability, scalability, and cost-efficiency
Set technical direction for how HubSpot deploys and operates ML models at scale, guiding decisions on architecture, cost optimization, and developer experience
Work closely with Machine Learning Engineers, Product Software Engineers, and other Infrastructure teams to streamline model deployment and serving
Gain deep exposure to a wide range of HubSpot infrastructure systems through building and maintaining core Python libraries, an excellent opportunity to learn how HubSpot operates under the hood
Collaborate with HubSpotters all over the company, whether in engineering, product, design, research, marketing, sales, etc, gaining exposure to how HubSpot works as a business
Be empowered to show up as your authentic self and choose a work style and location where you can do your best work, whether that's at home, in an office, or a blend of the two
Perks and Benefits
We value both flexibility and connection for all employees, whether you're Remote or work from the Office
Opportunities for in-person onboarding and other events to build connections