Platform - ML R&D - Principal Research/Data Scientist

Requirements

• Excellent comprehension of the industrial and academic state of the art on xLMs, more specifically in retrieval and reranking techniques
• Extensive professional experience in designing, training, and debugging various model architectures as well testing and implementing post-training strategies; proven track record of assessing, proposing and integrating frontier techniques to large scale products
• 6+ years of professional software development experience in Python (pytorch)
• Experience with large-scale model training (between 0.1 and 7B parameters), distributed training, and model optimization techniques (e.g., quantization, pruning, efficient attention mechanisms)
• Excellent communication skills and gentle approach to leadership
• Strong attention to detail and highly organized

What You'll Be Doing

• Strategic research & technical roadmap definition: identify promising new technologies for text-only and multi-modal models, look into post-training methodologies relevant for retrieval and re-ranking, and champion solutions that will fit best in Elastic
• Tooling: improve our infrastructure and help scale to accommodate larger models: provide expert guidance on distributing data preparation, training and testing on multiple GPUs, help design, improve and write specs for our compute infrastructure
• Model variants exploration: investigate applying fine-tuning, quantization, distillation and other techniques to existing or upcoming models
• Technical leadership: foster a culture of innovation and rigorous experimentation, coordinate knowledge sharing within the team; act as a senior technical authority and go-to expert for the modeling, training and testing challenges; mentor more junior members of the team helping them develop their skills and knowledge
• Communication: interact with various leads across the organization, communicate sophisticated concepts to high profile stakeholders, adjust and iterate on the roadmap according to internal and external inputs

Perks and Benefits

• Competitive pay based on the work you do here and not your previous salary
• Health coverage for you and your family in many locations
• Ability to craft your calendar with flexible locations and schedules for many roles
• Generous number of vacation days each year
• Increase your impact - We match up to $2000 (or local currency equivalent) for financial donations and service
• Up to 40 hours each year to use toward volunteer projects you love
• Embracing parenthood with a minimum of 16 weeks of parental leave