Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
ROCm
/
ATOM
Public
Notifications
You must be signed in to change notification settings
Fork
141
Star
170
Code
Issues
86
Pull requests
240
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Security and quality
Insights
refactor(kv-cache): one declaration per fact about the KV pools
- #2147
#2147
Merged
valarLip
merged 26 commits into
main
ROCm/ATOM:main
from
refactor/m3-index-topk-single-selector
ROCm/ATOM:refactor/m3-index-topk-single-selector
Copy head branch name to clipboard
Sep 7, 2026
Conversation
Commits
26
(26)
Checks
Files changed
Merged
refactor(kv-cache): one declaration per fact about the KV pools
#2147
valarLip
merged 26 commits into
main
ROCm/ATOM:main
from
refactor/m3-index-topk-single-selector
ROCm/ATOM:refactor/m3-index-topk-single-selector
Copy head branch name to clipboard
Commits
Commits on Sep 5, 2026
refactor(minimax-m3): keep one indexer selector, not two
Show description for 6487407
valarLip
committed
6487407
View commit details
Copy full SHA for 6487407
Browse repository at this point
perf(deepseek-v4): raise the FP4 MQA grid floor to 4096
Show description for e9b4934
valarLip
committed
e9b4934
View commit details
Copy full SHA for e9b4934
Browse repository at this point
Commits on Sep 6, 2026
refactor(pool-layout): name the arena after its axis, not the pool it serves
Show description for edd1292
valarLip
committed
edd1292
View commit details
Copy full SHA for edd1292
Browse repository at this point
refactor(kv-cache): one declaration of what an MHA block holds
Show description for 15952e7
valarLip
committed
15952e7
View commit details
Copy full SHA for 15952e7
Browse repository at this point
refactor(kv-cache): give MLA the same one-declaration pool as MHA
Show description for 9275b3a
valarLip
committed
9275b3a
View commit details
Copy full SHA for 9275b3a
Browse repository at this point
refactor(kv-cache): declare M3's indexer cache, and hand a builder its block count
Show description for 1a55b80
valarLip
committed
1a55b80
View commit details
Copy full SHA for 1a55b80
Browse repository at this point
refactor(kv-cache): one allocation for every paged pool, one region each
Show description for 02805ad
valarLip
committed
02805ad
View commit details
Copy full SHA for 02805ad
Browse repository at this point
refactor(kv-cache): let the bind walk hand out pool rows, and the modules declare the pools
Show description for 481f7af
valarLip
committed
481f7af
View commit details
Copy full SHA for 481f7af
Browse repository at this point
refactor(selector): one attention family, decided where the backends are
Show description for a6e7ca2
valarLip
committed
a6e7ca2
View commit details
Copy full SHA for a6e7ca2
Browse repository at this point
refactor(kv-cache): declare what a V4 KV row and indexer block hold, once
Show description for 3629301
valarLip
committed
3629301
View commit details
Copy full SHA for 3629301
Browse repository at this point
refactor(kv-cache): give a module its pool row, instead of counting the walk
Show description for 164bcc0
valarLip
committed
164bcc0
View commit details
Copy full SHA for 164bcc0
Browse repository at this point
style(mha): declare BLOCK_TABLE_EXTENDER a ClassVar
Show description for 95fd44c
valarLip
committed
95fd44c
View commit details
Copy full SHA for 95fd44c
Browse repository at this point
fix(minimax-m3): stop the indexer tests from aborting collection
Show description for b552e94
valarLip
committed
b552e94
View commit details
Copy full SHA for b552e94
Browse repository at this point
chore(hooks): report what ruff could not fix, and clear what it reported
Show description for acb112f
valarLip
committed
acb112f
View commit details
Copy full SHA for acb112f
Browse repository at this point
Commits on Sep 7, 2026
fix(rollout): free the KV pool by what an attribute holds, not by its name
Show description for fbba98e
valarLip
committed
fbba98e
View commit details
Copy full SHA for fbba98e
Browse repository at this point
fix(kv-cache): raise on config that `python -O` would let through
Show description for e81578a
valarLip
committed
e81578a
View commit details
Copy full SHA for e81578a
Browse repository at this point
fix(kv-cache): let an arena refuse a buffer it cannot honor
Show description for 5dcca35
valarLip
committed
5dcca35
View commit details
Copy full SHA for 5dcca35
Browse repository at this point
refactor(kv-cache): separate the scheduler's block from the backend's
Show description for e4b4f50
valarLip
committed
e4b4f50
View commit details
Copy full SHA for e4b4f50
Browse repository at this point
fix(kv-cache): refuse P/D for a model with per-request state
Show description for c17c8b4
valarLip
committed
c17c8b4
View commit details
Copy full SHA for c17c8b4
Browse repository at this point
fix(kv-cache): let an entry-major plane hold no fields
Show description for 10ee5a0
valarLip
committed
10ee5a0
View commit details
Copy full SHA for 10ee5a0
Browse repository at this point
refactor(spec-decode): size a draft's pool from the walk that addresses it
Show description for f0f3a68
valarLip
committed
f0f3a68
View commit details
Copy full SHA for f0f3a68
Browse repository at this point
docs: point five references at symbols that still exist
Show description for 4cfa92e
valarLip
committed
4cfa92e
View commit details
Copy full SHA for 4cfa92e
Browse repository at this point
refactor(attention): name the token axis a batch id maps from
Show description for 053c921
valarLip
committed
053c921
View commit details
Copy full SHA for 053c921
Browse repository at this point
fix(v4): read the indexer's batch ids off the metadata, not a copy in the dict
Show description for 71ad8c6
valarLip
committed
71ad8c6
View commit details
Copy full SHA for 71ad8c6
Browse repository at this point
fix(v4): write the MTP draft's batch ids on the device, not through the host
Show description for 3b1b7a0
valarLip
committed
3b1b7a0
View commit details
Copy full SHA for 3b1b7a0
Browse repository at this point
fix(spec-decode): block a draft's pool at the target's, not at its own rule
Show description for f8013af
valarLip
committed
f8013af
View commit details
Copy full SHA for f8013af
Browse repository at this point
You can’t perform that action at this time.