Research Scientist, Gemini for Android XR Devices

Requirements:

• PhD in Computer Science, a related field, or equivalent practical experience.
• Experience with Computer Vision, Generative AI, or Large Language Models.
• One or more scientific publication submission(s) for conferences, journals, or public repositories (such as CVPR, ICCV, NeurIPS, ICML, ICLR, etc.).
• Experience in machine learning, specifically for Generative AI and video applications.

Nice to Haves:

• 2 years of coding experience.
• 1 year of experience owning and initiating research agendas.
• Experience working on multimodal understanding problems, including image or video understanding tasks.
• Experience working with egocentric data and egocentric problems.
• Experience working in an industry or academic research lab, focusing on multiple aspects of the "research to product" pipeline.

What You'll Be Doing:

• Define the data structure, framework, design, and evaluation metrics for research solution development and implementation under minimal guidance. Identify timelines and obtain resources needed.
• Work on the integration of Gemini into XR products. Design and implement customization layers to enable the next generation of immersive XR experiences powered by Gemini.
• Work together with research teams to highlight model limitations and improve performance in key areas critical for XR applications like spatial and temporal understanding.
• Develop expertise on the full data collection, filtering and pre-processing pipeline to contribute with freshly sourced data to improve the quality of models in egocentric video understanding applications.
• Establish and maintain relationships with main stakeholders and keep recurring updates on the advancements of the project, making sure that their expectations are aligned to the research and engineering work.

Perks and Benefits:

• Not specified in the provided job description.