Skip to content
Kitbay
Skill

double-check-perf-tests

Apache-2.0Updated on Nov 11, 202650,877GitHub starsIncludes scripts

A maintainer skill in the ClickHouse repository that checks a CI performance comparison result locally for a given commit.

What the skill teaches

A maintainer skill in the ClickHouse repository that checks a CI performance comparison result locally for a given commit. The agent finds the pull request with the GitHub CLI, detects the local CPU architecture and reads the queries CI flagged as faster or slower from each performance shard's report, stopping with an error if no usable shard ran. It looks up the reference commit through ClickHouse's public query service, downloads the pull request and master binaries, starts two local servers and reruns only the affected queries with the repository's performance script. A table compares CI and local numbers with a verdict per query, confirmed only when the change matches in direction and exceeds both thresholds. Datasets are fetched only after asking.

Capabilities

  • Read flagged queries from CI performance reports
  • Download the pull request and reference binaries
  • Rerun affected queries on two local servers
  • Give a verdict per query against CI