Skip to content
Kitbay
Skill

run-eval-harbor

NOASSERTIONUpdated on Nov 11, 202684,974GitHub starsIncludes scripts

A maintainer skill in the LobeHub repository for running and troubleshooting existing Harbor or FrontierHarness evaluations against a LobeHub server, either a local production build from the checkout or a remote one.

What the skill teaches

A maintainer skill in the LobeHub repository for running and troubleshooting existing Harbor or FrontierHarness evaluations against a LobeHub server, either a local production build from the checkout or a remote one. Before acting it asks for every choice: server, where jobs run (local Docker, an SSH worker or Runta), which build of the lh command-line tool to use, the agent, the evaluation repository, new job or resume, and credentials. It enforces guardrails such as a fixed local port, a smoke test before every real job and never printing secrets, runs the bundled smoke script and then the job, exports trajectories, and traces failures to the evaluation services, LobeHub, the gateway, Docker networking or the task verifier.

Capabilities

Not stated in its documentation