[CI] Add opt-in paired performance check for pull requests (ci:perf) - #2152

Draft

zufayu wants to merge 28 commits into

mainfrom

Commits on Sep 7, 2026

Commits on Sep 8, 2026

[CI] Warm the caches, and measure the base commit twice
zufayu
committed
798571e
[CI] Report three independent metrics per level, not one
zufayu
committed
0fc74ad
[CI] Pass the benchmark parameters into the container explicitly
zufayu
committed
db05954
[CI] Name the report columns for the reader, and clear the GPUs first
zufayu
committed
e29aa4a
[CI] Drop the repeated base reading; report the measured bias instead
zufayu
committed
0e70a12
[CI] Check the baseline against main before trusting the comparison
zufayu
committed
1268685
[CI] Report main-side drift alongside the paired result
zufayu
committed
cf8175f
[CI] Reclaim disk before starting, including the runner's own space
zufayu
committed
7f0db98
perf-check: drop dead columns from the step summary, match the comment's wording
zufayu
committed
b78d730
perf-check: warm up with the same prompt count as the measurement
zufayu
committed
a547448
perf-check: the equal-length warmup removed the bias; report spread instead
zufayu
committed
ad0f2bf
perf-check: make the warmup length a knob so it can be varied alone
zufayu
committed
e85ce68

Commits on Sep 9, 2026