本文へスキップ
Kitbay
スキル公式

launchdarkly-online-evals

Apache-2.02026年11月11日 更新138GitHubスター

A partner-maintained skill for AWS DevOps Agent, from LaunchDarkly, for automatic quality scoring of AI config output in LaunchDarkly using judges, where one model rates another.

スキルの内容

A partner-maintained skill for AWS DevOps Agent, from LaunchDarkly, for automatic quality scoring of AI config output in LaunchDarkly using judges, where one model rates another. It covers the built-in judges, creating custom judges, attaching them to config variations, setting sampling rates and watching quality scores, and notes that judges work only in completion mode. It needs the hosted LaunchDarkly MCP server, and SDK examples use the Python and Node.js AI SDKs.

できること

  • Attach judges to AI config variations
  • Create custom judges
  • Set evaluation sampling rates
  • Monitor quality scores