Skip to content
Kitbay
Skill

perf-report

Apache-2.0Updated on Nov 11, 202650,877GitHub stars

A maintainer skill in the ClickHouse repository for reading the CI performance comparison report of a ClickHouse pull request.

What the skill teaches

A maintainer skill in the ClickHouse repository for reading the CI performance comparison report of a ClickHouse pull request. Given a pull request number or report link, the agent fetches results for x86 and ARM runs with a repository script, lists every query that got more than 10 percent slower or faster, and checks each one against 30 days of master runs in the public CI database on play.clickhouse.com. Each change is classed as flaky, unstable, a new regression, a new improvement or rare on master, with counts per architecture. On request it digs into server logs, flame graphs from trace logs and per-query metrics from the CI artifacts. It never hides a change without evidence.

Capabilities

  • List queries that changed speed in a pull request
  • Check changes against master history
  • Class changes as flaky or new
  • Compare flame graphs and server logs