testing-heterogeneous-agents
A maintainer skill in the LobeHub repository, run only when someone calls it, that checks whether six external command-line agents, among them Claude Code, Codex and TRAE, work through LobeHub's built-in official model provider in the desktop app.
What the skill teaches
A maintainer skill in the LobeHub repository, run only when someone calls it, that checks whether six external command-line agents, among them Claude Code, Codex and TRAE, work through LobeHub's built-in official model provider in the desktop app. A bundled Node harness first lists the matrix from the live capability response and the CLIs already installed, without calling any model; real runs make billable requests, so they need approval under the acceptance skill and an explicit confirm flag. Cells run one after another, each with a unique marker checked on the round trip, and results are saved as evidence files and published to LobeHub's acceptance records. Failures are diagnosed layer by layer.
Capabilities
- List the agent and model test matrix without model calls
- Run live round-trip checks per agent and model
- Save evidence files for each test cell
- Locate the failing layer of a broken cell
About
- Publisher
- LobeHub
- Tool
- Testing
Install
The project doesn't document install steps that we could confirm. See the project's own instructions
What's inside
- agents/openai.yaml
- scripts/official-smoke.mjs
- scripts/official-smoke.test.sh
MCP servers and skills can run code on your computer and act on your data. Review the source before installing.
This skill includes scripts that your agent may run.
Details
| Fact | Value | Source |
|---|---|---|
| Type | Skill | |
| Tool | Testing | |
| Publisher | LobeHub | source |
| Official status | Not stated in its documentation | |
| Needs an API key or sign-in | Not stated in its documentation | |
| Includes scripts | Yes | source |
| Platforms | Not stated in its documentation | |
| AI clients | Not stated in its documentation | |
| Licence | NOASSERTION | source |
| Pricing | Not stated in its documentation | |
| Activity | Last commit Nov 11, 202684,974 GitHub starsDownload data not available (not on npm or PyPI) | source |
| Links | Repository Website |
More from LobeHub
33 skills
- pr (Skill)
- acceptance (Skill)
- add-model-provider (Skill)
- add-setting-env (Skill)
- agent-signal (Skill)
- agent-testing-bot (Skill)
Also listed under: Testing
Sources
- Skill file (SKILL.md)github.com/lobehub/lobehub · Backs: Includes scriptsNov 16, 2026
- GitHub repositorygithub.com/lobehub/lobehub · Backs: Publisher, ActivityNov 11, 2026
- Skill file (SKILL.md)github.com/lobehub/lobehub · Backs: LicenceNov 10, 2026
- Folder in the repository (testing-heterogeneous-agents)github.com/lobehub/lobehub · Backs: Includes scriptsNov 10, 2026