Engineering Analyst, Responsible AI Testing

Requirements:

• Bachelor's degree or equivalent practical experience.
• 5 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data.
• 5 years of experience managing projects and defining project scope, goals, and deliverables.

Nice to haves:

• Master's degree in a quantitative discipline.
• 5 years of experience or familiarity with one or more of the following languages: SQL, R, Python, or C++.
• Experience working in Trust and Safety or Responsible AI.
• Experience with operational process design and workflow optimization.
• Strong understanding of AI/ML evaluation metrics (e.g., precision, recall, F1) and LLM limitations.
• Comfortable working with data analytics, interpreting ML model performance metrics, and understanding technical architecture to identify safety gaps.

What you'll be doing:

• Manage the full lifecycle of technical requests (e.g., bugs, feature requests) for the team.
• Drive the strategic roadmap for RAI Sustainability by identifying high-impact opportunities through data analysis.
• Serve as the central communication hub for RAI Testing Sustainability.
• Lead the technical evaluation of new testing capabilities.
• Engineer closed-loop feedback systems where testing insights directly inform model development.

Perks and benefits:

• Opportunity to work with a global team and cross-functional collaboration.
• Work on cutting-edge technologies in the field of Responsible AI.
• Continuous learning and professional development opportunities.
• Competitive compensation package.