exp: v1 runtime benchmark matrix#1630

Draft

mikasenghaas wants to merge 9 commits into

feat/nano-as-v1from

exp/v1-bench-runtime-matrix

Commits on Jun 11, 2026

exp(bench): v1 runtime benchmark matrix (subprocess/docker/prime)

mikasenghaas
and
claude
committed
exp(bench): single-turn results + plot.py; script fixes for the current base

mikasenghaas
and
claude
committed
exp(bench): per-cell result files + docker cells (capped); MAX_CONCURRENT knob

mikasenghaas
and
claude
committed
exp(bench): add modal single-turn cells

mikasenghaas
and
claude
committed
exp(bench): refresh modal single-turn cells (clean under raised parallel limit)

mikasenghaas
and
claude
committed
exp(bench): record scoring + total durations; p10/p50/p90 stage plot

mikasenghaas
and
claude
committed

Commits on Jun 12, 2026