bmad-eval
A skill from the BMAD Method that runs a skill's evaluations through the agent tool the user works in and reports the results.
What the skill teaches
A skill from the BMAD Method that runs a skill's evaluations through the agent tool the user works in and reports the results. It has four modes: whether the skill beats the bare model on the same input, whether a stripped or earlier version does as well, whether output meets a named rubric with a grader subagent, and whether the skill's description triggers on the right queries. Each case runs in a clean temporary workspace outside the project, and bundled Python scripts run cases, test triggers, convert case files and summarise repeated runs. It refuses to invent cases, labels results from fewer than three runs a quick look, and suggests retiring a skill that no longer beats the baseline.
Capabilities
- Compare a skill against the bare model
- Test whether a stripped version does as well
- Grade output against a rubric
- Check whether a skill description triggers correctly
About
- Publisher
- BMad Code
- Tool
- Testing
Install
The project doesn't document install steps that we could confirm. See the project's own instructions
What's inside
- bmod.toml
- customize.toml
- evals/triggers.json
- references/description-optimization.md
- references/eval-format.md
- references/grader.md
- references/harness.md
- references/self-improvement.md
- scripts/aggregate_benchmark.py
- scripts/convert_cases.py
- scripts/eval_common.py
- scripts/run_evals.py
- scripts/run_triggers.py
- scripts/tests/fake_harness.py
- scripts/tests/test_aggregate_benchmark.py
- scripts/tests/test_convert_cases.py
- scripts/tests/test_eval_common.py
- scripts/tests/test_run_evals.py
- scripts/tests/test_run_triggers.py
MCP servers and skills can run code on your computer and act on your data. Review the source before installing.
This skill includes scripts that your agent may run.
Details
| Fact | Value | Source |
|---|---|---|
| Type | Skill | |
| Tool | Testing | |
| Publisher | BMad Code | source |
| Official status | Not stated in its documentation | |
| Needs an API key or sign-in | Not stated in its documentation | |
| Includes scripts | Yes | source |
| Platforms | Not stated in its documentation | |
| AI clients | Not stated in its documentation | |
| Licence | MIT | source |
| Pricing | Not stated in its documentation | |
| Activity | Last commit Nov 11, 202655,252 GitHub starsDownload data not available (not on npm or PyPI) | source |
| Links | Repository |
More from BMad Code
8 skills
- bmad-agent-pm (Skill)
- bmad-agent-po (Skill)
- bmad-deep-recon (Skill)
- bmad-toolsmith (Skill)
- bmad-ux (Skill)
- bmad (Skill)
Also listed under: Testing
Sources
- Skill file (SKILL.md)github.com/bmad-code-org/BMAD-METHODNov 16, 2026
- GitHub repositorygithub.com/bmad-code-org/BMAD-METHOD · Backs: Licence, PublisherNov 16, 2026
- GitHub API recordgithub.com/bmad-code-org/BMAD-METHOD · Backs: Includes scriptsNov 16, 2026
- GitHub repositorygithub.com/bmad-code-org/bmad-method · Backs: ActivityNov 11, 2026
- Skill file (SKILL.md)github.com/bmad-code-org/BMAD-METHOD · Backs: LicenceNov 10, 2026
- Folder in the repository (bmad-eval)github.com/bmad-code-org/BMAD-METHOD · Backs: Includes scriptsNov 10, 2026