Skip to content
Kitbay
Skill

keeper-stress-analysis

Apache-2.0Updated on Nov 11, 202650,877GitHub starsIncludes scripts

A maintainer skill in the ClickHouse repository for analysing ClickHouse Keeper stress-test results, such as checking a Keeper pull request against the stress dashboards or explaining a nightly regression.

What the skill teaches

A maintainer skill in the ClickHouse repository for analysing ClickHouse Keeper stress-test results, such as checking a Keeper pull request against the stress dashboards or explaining a nightly regression. Bundled shell and Python scripts query the stress metrics table on the public play.clickhouse.com service over HTTP, fetch pull request details with the GitHub CLI, and build tables of cumulative gains, per-PR changes, noise levels and comparisons between commits. Before quoting numbers the agent applies checks learned from past mistakes: how memory is measured, harness changes that shift results, a noise band of a few percent, CPU at the 95th percentile and pull requests merged together. Reports include a verdict, a table and caveats.

Capabilities

  • Pull Keeper stress metrics from play.clickhouse.com
  • Attribute performance changes to pull requests
  • Calibrate the noise floor before comparing runs
  • Write a validation report with caveats