eval-harness
A skill from the ECC collection for eval-driven development in AI coding sessions, treating evals as the unit tests of agent work.
What the skill teaches
A skill from the ECC collection for eval-driven development in AI coding sessions, treating evals as the unit tests of agent work. Before coding, the agent writes capability evals for new behaviour and regression evals against a baseline, stored under .claude/evals; it then implements, runs them and reports pass and fail counts. Graders can be code checks such as tests or builds, a model scoring against a rubric, rule or schema checks, or a human for risky changes such as security. Reliability is tracked as pass@k and the stricter pass^k. Bundled local scripts keep hash-linked records of runs, but executing candidate code is disabled on every system until a reviewed isolation layer exists.
Capabilities
- Define capability and regression evals before coding
- Grade results with code, model or human checks
- Track pass@k and pass^k reliability
- Write an eval report for a feature
About
- Publisher
- affaan-m
- Tool
- Testing
Works with
Install
What's inside
- agents/openai.yaml
MCP servers and skills can run code on your computer and act on your data. Review the source before installing.
Details
| Fact | Value | Source |
|---|---|---|
| Type | Skill | |
| Tool | Testing | |
| Publisher | affaan-m | source |
| Official status | Not stated in its documentation | |
| Needs an API key or sign-in | Not stated in its documentation | |
| Includes scripts | No | source |
| Platforms | Not stated in its documentation | |
| AI clients | Claude Code, Codex | source |
| Licence | MIT | source |
| Pricing | Not stated in its documentation | |
| Activity | Last commit Nov 17, 2026305,644 GitHub starsDownload data not available (not on npm or PyPI) | source |
| Links | Repository Website |
Other copies of this skill (1)
These differ from this skill's text. They may be adapted copies or older versions.
- eval-harnessgongyijie85/dsh-ecc
More from affaan-m
35 skills
- brand-discovery (Skill)
- brand-voice (Skill)
- context-and-decisions (Skill)
- docs-governance (Skill)
- e2e-testing (Skill)
- fal-ai-media (Skill)
Also listed under: Testing
Sources
- GitHub repositorygithub.com/affaan-m/ecc · Backs: AI clients, Licence, Publisher, ActivityNov 18, 2026
- Skill file (SKILL.md)github.com/affaan-m/eccNov 16, 2026
- Skill file (SKILL.md)github.com/affaan-m/ECCNov 18, 2026
- Folder in the repository (eval-harness)github.com/affaan-m/ECC · Backs: Includes scriptsNov 18, 2026