Staff AI Engineer - MCP Services

Requirements:

• Experienced Staff-level engineer with a background in applied AI, agentic programming, etc.
• Comfortable in high ambiguity and fast-changing environments
• Skilled in building evaluation frameworks for LLM agents or AI systems
• Strong systems thinking skills
• Passionate about pushing boundaries in agent-augmented software

What You'll Be Doing:

• Lead efforts to improve Datadog’s public-facing MCP server
• Design and implement agentic tool surfaces for evaluation and production use
• Build and maintain advanced evaluation pipelines for measuring agent performance
• Investigate and resolve failure cases for tool output and agent feedback
• Collaborate with internal teams on standards for tool integration and data access

Perks and Benefits:

• Generous and competitive benefits package
• New hire stock equity (RSUs) and employee stock purchase plan
• Continuous career development opportunities
• Employee-focused best in class onboarding
• Internal mentor and cross-departmental buddy program
• Friendly and inclusive workplace culture