Skip to content
Kitbay
Skill

agent-host-e2e-tests

MITUpdated on Nov 11, 2026195,341GitHub stars

A contributor skill in the VS Code repository for the Agent Host end-to-end and provider integration tests.

What the skill teaches

A contributor skill in the VS Code repository for the Agent Host end-to-end and provider integration tests. It explains that tests replay recorded model traffic by default and fail on any unrecorded request, that fixtures are named after test titles and are never edited by hand, and how to choose between conformance, parity and host-only tests. The agent writes small deterministic scenarios, records fixtures for each provider with a GitHub token, reviews them for leaked names, paths or tokens, gates tests that cannot replay reliably with a logged known issue, and checks every new test on Windows, Linux and macOS in VS Code's Azure pipeline before merge.

Capabilities

  • Write deterministic Agent Host end-to-end tests
  • Record and review replay fixtures for each provider
  • Gate tests that cannot replay reliably
  • Validate tests on three platforms in Azure Pipelines