Zum Inhalt springen
Kitbay

benchmark-sandbox

Apache-2.0Aktualisiert am 10. Nov. 2026333GitHub-SterneEnthält Skripte

A maintainer skill for running vercel-plugin evaluations in Vercel Sandboxes instead of local terminal panes.

Was der Skill vermittelt

A maintainer skill for running vercel-plugin evaluations in Vercel Sandboxes instead of local terminal panes. Each sandbox is a short-lived microVM set up with Claude Code, the Vercel CLI, agent-browser and a local copy of the plugin. A three-phase run builds an app, checks user stories in a browser and deploys it, and a Haiku model scores each phase as structured JSON. TypeScript runner scripts in the skill folder handle provisioning, running and analysis. It needs Vercel access and is meant for people developing the plugin.

Funktionen

  • Provision Vercel Sandboxes with Claude Code and the plugin installed
  • Run build, verify and deploy phases for benchmark scenarios
  • Score each phase with structured model output
  • Collect skill coverage across the phases