Skip to content
Kitbay

triage-flaky-test

MITUpdated on Nov 9, 2026185GitHub stars

A Datadog skill for investigating one flaky test with Datadog Test Optimization data.

What the skill teaches

A Datadog skill for investigating one flaky test with Datadog Test Optimization data. Using the Datadog MCP server's software delivery tools, or the pup CLI as a fallback, the agent fetches the test's flaky state and recent failures, decides whether the current change introduced the flakiness or inherited it, checks how widely it fails, and tries a code fix where a known pattern applies. It ends with a triage brief recommending a fix, quarantine in Datadog or escalation. The repository is read from the git remote when not given.

Capabilities

  • Fetch a flaky test's history from Datadog
  • Decide whether a change introduced the flakiness
  • Measure how widely a flaky test fails
  • Recommend a fix, quarantine or escalation