Improve CodSpeed benchmark observability - #48

Merged

Bobronium merged 36 commits into

mainfrom

improve-benchmarks

Mar 26, 2026

Commits on Mar 21, 2026

Improve CodSpeed benchmark observability
Bobronium
committed
0d2e539
Make CodSpeed workflow reusable-only
Bobronium
committed
297258b
Run CodSpeed independently from the build matrix
Bobronium
committed
da42289
Clear sccache wrapper before CodSpeed setup
Bobronium
committed
220f0c8
Stabilize CodSpeed benchmark sequencing
Bobronium
committed
1ae5ed4
Restore CodSpeed simulation to build lanes
Bobronium
committed
cf68572

Commits on Mar 23, 2026

Add CodSpeed walltime benchmarks
Bobronium
committed
c99851a
Reuse build artifact for CodSpeed walltime
Bobronium
committed
4e681cd
Avoid waiting on CodSpeed walltime runner
Bobronium
committed
b1aa0e0
Rewrite benchmarks
Bobronium
committed
1b741ed
Fix linting
Bobronium
committed
02ab4ed
Update cd-build.yaml
Bobronium
committed
4c588fd

Commits on Mar 24, 2026

Update cd-build.yaml
Bobronium
committed
01287d3
Remove tzinfo from test data
Bobronium
committed
838c703
Bisect codspeed walltime
Bobronium
committed
b623086
Skip CI tests on PRs
Bobronium
committed
a0888c6
Try running walltime with minimal params
Bobronium
committed
c1e01c8
Add a small warmup and increase rounds to two
Bobronium
committed
277e4f2
Remove custom parameters for the walltime
Bobronium
committed
a1dee19
Use max time of 1 and warmup time of 0.1
Bobronium
committed
4f935b9
Use max time 3
Bobronium
committed
343c047
Use max time 2
Bobronium
committed
dcb2f6c
Give benchmarks a headstart
Bobronium
committed
177bb3d
Fix broken dependency
Bobronium
committed
7430c2d
Remove duplicated steps
Bobronium
committed
b185feb
Add missing steps to leading_tests
Bobronium
committed
a3fa1e0
Rename leading_wheel -> leading_wheels
Bobronium
committed
b8760a3
Allow leading tests to fail, but tests to run
Bobronium
committed
e2f2150
Fix leading wheels dependency
Bobronium
committed
c095216
Run sumulatiob & memory on x86
Bobronium
committed
3b5ec2d
Fix missing wheel for benchmarks
Bobronium
committed
19a48f4

Commits on Mar 25, 2026

Don't run memory benchmarks for small cases
Bobronium
committed
3a38613
Collapse wheels and tests jobs
Bobronium
committed
e35e8d2

Commits on Mar 26, 2026

Increase max time for walltime and allow it to fail
Bobronium
committed
b1034ea
Remove bisect_codspeed_walltime.py
Bobronium
committed
89e2bc3
Remove codpseed entry in taskfile.yaml
Bobronium
committed
91c1ec5