agent-eval
A contributor skill in the CodeGraph repository for measuring how much CodeGraph helps a coding agent.
What the skill teaches
A contributor skill in the CodeGraph repository for measuring how much CodeGraph helps a coding agent. The user picks a CodeGraph version (the local build, the latest release or a given number), a language and a real repository from the project's test corpus, and a headless or tmux-driven run mode. The agent starts the harness, which rebuilds the index with that version and runs Claude Code on a set question with and without CodeGraph, then reports tool calls, file reads, duration and cost for each side, checking first that the runs did not contaminate each other. It needs tmux, Node, git and a signed-in Claude CLI on macOS or Linux.
Capabilities
Not stated in its documentation
About
- Publisher
- colbymchenry
Install
The project doesn't document install steps that we could confirm. See the project's own instructions
What's inside
- corpus.json
MCP servers and skills can run code on your computer and act on your data. Review the source before installing.
This skill includes scripts that your agent may run.
Details
| Fact | Value | Source |
|---|---|---|
| Type | Skill | |
| Tool | Not stated in its documentation | |
| Publisher | colbymchenry | source |
| Official status | Not stated in its documentation | |
| Needs an API key or sign-in | Not stated in its documentation | |
| Includes scripts | Yes | source |
| Platforms | macOS, Linux | source |
| AI clients | Not stated in its documentation | |
| Licence | MIT | source |
| Pricing | Not stated in its documentation | |
| Activity | Last commit Nov 1, 202677,376 GitHub starsDownload data not available (not on npm or PyPI) | source |
| Links | Repository Website |
Copies of this skill in other repositories (1)
These differ from this skill's text. They may be adapted copies or older versions.
- agent-evalethanyoq/skill-hub
More from colbymchenry
1 server · 2 skills
All 3 from colbymchenry →Sources
- GitHub repositorygithub.com/colbymchenry/codegraph · Backs: Licence, Publisher, ActivityNov 11, 2026
- Skill file (SKILL.md)github.com/colbymchenry/codegraph · Backs: Platforms, Includes scriptsNov 10, 2026
- Folder in the repository (agent-eval)github.com/colbymchenry/codegraph · Backs: Includes scriptsNov 10, 2026