Requirements

Master's degree in a Health-related field (e.g., Medicine, Public Health, Biomedical Informatics), or equivalent practical experience.
Experience measuring the performance of Large Language Models (LLMs) or generative AI tools and optimizing them for healthcare or clinical use cases.

Nice to Haves

Experience breaking down clinical workflows into concrete tasks, evaluation rubrics, and quality standards.
Experience prioritizing AI capabilities and collaborating closely with cross-functional technical partners to unlock value for healthcare professionals.
Demonstrated dual expertise bridging healthcare and AI, such as transitioning from a clinical practitioner into a technical machine learning role, or vice versa.
Strong technical capabilities evaluating machine learning models, and applying Large Language Models to complex health workflows.

Set the Health data strategy by mapping clinical workflows into a use-case taxonomy, and partnering with research to prioritize capabilities, data coverage, and sourcing pipelines.
Create high-quality Health data by designing tasks and rubrics, and QA-ing datasets from vendors, customers, and synthetic pipelines for correctness, realism, and coverage.
Steer data priorities using model failures by reproducing reported losses and stress-testing checkpoints on real workflows to identify missing clinical knowledge and false assumptions.
Build Health evaluations by assessing industry benchmarks to measure data strategy success, and advise cross-team evaluation efforts on clinical coverage and realism.
Scale expertise by recruiting and guiding Subject Matter Expert (SMEs), acting as the domain authority to enforce vendor quality, and converting expert contributions into usable training data.

Competitive salary (France: €130,000 - €133,000 + 20% bonus target; US: $207,000 - $300,000 + 20% bonus target) plus equity and benefits.
Opportunity to work at a pioneering AI lab focused on advancing AI for global challenges and scientific discovery.
Access to diverse learning opportunities and varied career pathways within global teams.