Senior Software Engineer, XR World Context

Requirements:

• Bachelor's degree in Computer Vision, Robotics, 3D sensing, a related field, or equivalent practical experience.
• 5 years of experience in Computer Vision, Robotics, or related fields.
• Experience contributing to research in the field of 3D surface reconstruction and semantic scene understanding.

Nice to Haves:

• Experience working in AR/VR/XR.
• Experience working with mobile DSPs for ML network acceleration.
• Strong skills in modern ML frameworks, VLMs, 3D math, real-time system implications of ML workloads.

What You'll Be Doing:

• Design, implement, and deploy lightweight scene representations to capture world-facing context signals and enable contextual triggers and panel placement for XR glasses.
• Create suitable ego-centric datasets, as well as the fusion and evaluation of different foundation models for building robust object- and scene-centric representations in real-time.
• Interface these representations with Gemini/Gemma variants. This unlocks powerful context-aware AI capabilities, such as voice-based spatial placement and on-device scene understanding for Spatial Gemini.

Perks and Benefits:

• Individual pay is determined by factors including job-related skills, experience, and relevant education or training.
• Germany: €128000 - €131000 (EUR) + 15% bonus target + equity + benefits