本文へスキップ
Kitbay
スキル

agent-eval

MIT2026年11月1日 更新77,376GitHubスタースクリプトあり

A contributor skill in the CodeGraph repository for measuring how much CodeGraph helps a coding agent.

スキルの内容

A contributor skill in the CodeGraph repository for measuring how much CodeGraph helps a coding agent. The user picks a CodeGraph version (the local build, the latest release or a given number), a language and a real repository from the project's test corpus, and a headless or tmux-driven run mode. The agent starts the harness, which rebuilds the index with that version and runs Claude Code on a set question with and without CodeGraph, then reports tool calls, file reads, duration and cost for each side, checking first that the runs did not contaminate each other. It needs tmux, Node, git and a signed-in Claude CLI on macOS or Linux.

できること

ドキュメントに記載なし