Zum Inhalt springen
Kitbay
Skill

agent-eval

MITAktualisiert am 1. Nov. 202677.376GitHub-SterneEnthält Skripte

A contributor skill in the CodeGraph repository for measuring how much CodeGraph helps a coding agent.

Was der Skill vermittelt

A contributor skill in the CodeGraph repository for measuring how much CodeGraph helps a coding agent. The user picks a CodeGraph version (the local build, the latest release or a given number), a language and a real repository from the project's test corpus, and a headless or tmux-driven run mode. The agent starts the harness, which rebuilds the index with that version and runs Claude Code on a set question with and without CodeGraph, then reports tool calls, file reads, duration and cost for each side, checking first that the runs did not contaminate each other. It needs tmux, Node, git and a signed-in Claude CLI on macOS or Linux.

Funktionen

In der Dokumentation nicht angegeben