Skip to content

Ring + Ulysses 2D context parallelism#404

Merged
copybara-service[bot] merged 1 commit into
mainfrom
wan-ulysses-bshd-attention
Jun 12, 2026
Merged

Ring + Ulysses 2D context parallelism#404
copybara-service[bot] merged 1 commit into
mainfrom
wan-ulysses-bshd-attention

Add explicit Ulysses ring attention sharding with segment-id masking

c104db5
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Jun 12, 2026 in 7s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

✅ c104db5 Author: @csgoogle <198951627+csgoogle​@users.noreply.github.com>, <sag******ara​@google.com>

(Only the first commit for a unique contributor is listed.)

View more details on Google CLA