agent-observability-experiment-bootstrap
A Datadog skill that writes a ready-to-run LLM Observability experiment file for your project.
What the skill teaches
A Datadog skill that writes a ready-to-run LLM Observability experiment file for your project. The agent settles the experiment's purpose, dataset (inline records, a local file or a named Datadog dataset), the task under test and the evaluators, then produces a script or notebook using either the Python ddtrace SDK, which is the default, or the Node dd-trace SDK, and checks it locally before reporting. Language-specific guidance and templates sit in its references folder and are loaded only for the chosen SDK. It needs Datadog credentials to record results.
Capabilities
- Generate an LLM experiment script or notebook
- Use the Python ddtrace or Node dd-trace SDK
- Wire in inline, local or Datadog-hosted datasets
- Add code-based or LLM-judge evaluators
About
- Publisher
- Datadog
- Tool
- Datadog
Install
What's inside
- references/node/nodejs.md
- references/python/env_setup_template.py
- references/python/evaluator-styles/class.md
- references/python/evaluator-styles/function.md
- references/python/evaluator-styles/remote.md
- references/python/providers/anthropic.md
- references/python/providers/bedrock.md
- references/python/providers/gemini.md
- references/python/providers/langchain.md
- references/python/providers/litellm.md
- references/python/providers/llamaindex.md
- references/python/providers/openai.md
- references/python/python.md
MCP servers and skills can run code on your computer and act on your data. Review the source before installing.
Details
| Fact | Value | Source |
|---|---|---|
| Type | Skill | |
| Tool | Datadog | |
| Publisher | Datadog | source |
| Official status | Officialdatadog-labs org; MIT licence copyright Datadog | source |
| Needs an API key or sign-in | Not stated in its documentation | |
| Includes scripts | No | source |
| Platforms | Not stated in its documentation | |
| AI clients | Not stated in its documentation | |
| Licence | MIT | source |
| Pricing | Not stated in its documentation | |
| Activity | Last commit Nov 9, 2026185 GitHub starsDownload data not available (not on npm or PyPI) | source |
| Links | Repository |
More from Datadog
2 servers · 70 skills
- agent-observability-auto-experiment (Skill)
- agent-observability-build-eval-from-annotations (Skill)
- agent-observability-eval-bootstrap (Skill)
- agent-observability-eval-pipeline (Skill)
- agent-observability-experiment-analyzer (Skill)
- agent-observability-online-experiment (Skill)
Badge for your README
Maintain this project? Add a badge that links to this page.
[](https://kitbay.app/skills/datadog-labs-agent-observability-experiment-bootstrap/)
Sources
- Skill file (SKILL.md)github.com/datadog-labs/agent-skillsNov 10, 2026
- README (README.md)github.com/datadog-labs/agent-skillsNov 13, 2026
- Licence file (LICENSE)github.com/datadog-labs/agent-skills · Backs: Licence, Official statusNov 13, 2026
- GitHub repositorygithub.com/datadog-labs/agent-skills · Backs: Publisher, Activity, LicenceNov 11, 2026
- Folder in the repository (agent-observability-experiment-bootstrap)github.com/datadog-labs/agent-skills · Backs: Includes scriptsNov 10, 2026
Other MCP servers and skills for Datadog
- agent-observability-auto-experiment(Skill)
- agent-observability-build-eval-from-annotations(Skill)
- agent-observability-eval-bootstrap(Skill)
- agent-observability-eval-pipeline(Skill)
- agent-observability-experiment-analyzer(Skill)
- agent-observability-online-experiment(Skill)
- datadog-app(Skill)
- dd-pup(Skill)
- View all →