feat: spilling hash join operator (opt-in, inner joins) - #2108

Draft

andygrove wants to merge 15 commits into

apache:mainfrom

andygrove:feat/spilling-hash-join

Commits on Jul 20, 2026

feat(core): add spilling hash join config keys
andygrove
committed
f9d2534
feat(core): scaffold SpillingHashJoinExec operator
andygrove
committed
ffe4322
feat(core): add hash row partitioner for spilling hash join
andygrove
committed
1a1d13e
feat(core): add in-memory probe table for spilling hash join
andygrove
committed
4f6742b
feat(core): execute SpillingHashJoinExec in memory
andygrove
committed
19e8334
feat(core): run spilling hash join in bounded memory
andygrove
committed
d0c339f
feat(core): recursively repartition oversized spilled buckets
andygrove
committed
656958b
feat(core): serialize SpillingHashJoinExec through the extension codec
andygrove
committed
5dcab97
test: distinguish left/right schemas in spilling hash join codec roundtrip
andygrove
committed
f075a48
feat(scheduler): add rule substituting spilling hash join for eligible joins
andygrove
committed
0347aab
feat(scheduler): apply spilling hash join rule in default planner
andygrove
committed
72dce15
refactor(scheduler): run spilling-hash-join substitution after broadcast promotion
andygrove
committed
55894bc
feat(scheduler): apply spilling hash join rule in AQE planner
andygrove
committed
d97b7a5
fix(spilling-hash-join): guard eligibility and construction, trim public api
andygrove
committed
9ea757c
fix(python): sync python/Cargo.lock with ballista-core smallvec dependency
andygrove
committed
45f48b1