Commits · d95d0f4b985f28ea381e301490f9d479b34d8980 · OpenDAS / vllm_cscc

24 Oct, 2025 2 commits
- [Distributed] Basic set of configuration for large EP deployment on GB200 (#27328) · d95d0f4b
  Pengchao Wang authored Oct 24, 2025
```
Signed-off-by: Pengchao Wang <wpc@fb.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  d95d0f4b
- [Misc] Avoid "PyTorch non-writable tensors" warning in RayPPCommunicator (#27443) · 09a6a49e
  Rui Qiao authored Oct 23, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  09a6a49e
22 Oct, 2025 2 commits

[Chore] Separate out system utilities from vllm.utils (#27201) · a0003b56
dongbo910220 authored Oct 23, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
a0003b56

[Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3

dongbo910220 authored Oct 22, 2025

Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3ae082c3

21 Oct, 2025 2 commits
- [V0 Deprecation] Remove V0 executors (#27142) · 647214f3
  Nick Hill authored Oct 21, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  647214f3
- [Chore] Separate out NCCL utilities from vllm.utils (#27197) · 6c728f77
  dongbo910220 authored Oct 21, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  6c728f77
19 Oct, 2025 1 commit

[Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f

iAmir97 authored Oct 19, 2025


Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>

7a6c8c3f

18 Oct, 2025 2 commits
- [Minor] Add some clarifying comments to recent changes (#27130) · 3b450752
  Nick Hill authored Oct 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  3b450752
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
17 Oct, 2025 1 commit
- [Perf] Exploit out-of-band buffers in shm_broadcast (#26961) · ab81379e
  Nick Hill authored Oct 16, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  ab81379e
16 Oct, 2025 2 commits
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
- Deepseek-v3 Batch Invariant on 8xH100 (#26609) · 7d8975de
  Bram Wasti authored Oct 15, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7d8975de
14 Oct, 2025 1 commit
- [UX] Replace VLLM_ALL2ALL_BACKEND with --all2all-backend (#26732) · 3e051bda
  Michael Goin authored Oct 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3e051bda
13 Oct, 2025 2 commits

[CI] Fix mypy for `vllm/distributed` (#26593) · 314285d4

Wentao Ye authored Oct 13, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

314285d4

[Log] Optimize Startup Log (#26601) · e251e457
Wentao Ye authored Oct 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
e251e457

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- [CI] Fix Pre-commit Issue Cannot determine type of "rank" and "world_size" (#26448) · 8983e021
  Wentao Ye authored Oct 09, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  8983e021
08 Oct, 2025 1 commit

[TPU] Rename tpu_commons to tpu_inference (#26279) · 335b28f7

Utkarsh Sharma authored Oct 08, 2025


Signed-off-by: Utkarsh Sharma <utksharma@google.com>
Co-authored-by: Utkarsh Sharma <utksharma@google.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>

335b28f7

06 Oct, 2025 1 commit
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
01 Oct, 2025 1 commit

[Misc]allow disable pynccl (#25421) · f48b6a03

Lucia Fang authored Sep 30, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>

f48b6a03

29 Sep, 2025 1 commit
- [Bugfix][ROCm] Fixing trying to import non-existent symbols from libnccl.so (#25605) · 61a34316
  Gregory Shtrasberg authored Sep 29, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  61a34316
27 Sep, 2025 1 commit
- [Bugfix][WideEP] Apply TP Attn + EP MoE fix to other models (#24982) · a5354b3e
  Tyler Michael Smith authored Sep 27, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  a5354b3e
26 Sep, 2025 2 commits
- [Misc] Remove unnecessary memoryviews in shm_broadcast.py (#25721) · 983056e4
  Nick Hill authored Sep 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  983056e4
- [Misc] Don't log shm dequeue delay warning on worker side (#25720) · 8b77328f
  Nick Hill authored Sep 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8b77328f
25 Sep, 2025 2 commits
- [misc] log info messages by default for hanging / busy / idle (#25627) · 6c340da4
  youkaichao authored Sep 25, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  6c340da4
- [mypy] Fix wrong type annotations related to tuple (#25660) · 2f171176
  Cyrus Leung authored Sep 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f171176
24 Sep, 2025 2 commits

Support mnnvl all2allv from Flashinfer (#21003) · 54e42b72

Shu Wang authored Sep 24, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

54e42b72

[misc] update the warning message (#25566) · b67dece2
youkaichao authored Sep 24, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
b67dece2

23 Sep, 2025 5 commits

Remove redundant mutates_args and dispatch_key for direct_register_custom_op (#25512) · 7361ab37
Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
7361ab37
Enable symmetric memory all reduce by default only enabling for TP (#25070) · 8bdd8b5c
Ilya Markov authored Sep 23, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
8bdd8b5c

[core] add nccl symmetric memory for all reduce (#24532) · 8c1c81a3

Amir Samani authored Sep 23, 2025


Signed-off-by: Amir Samani <asamani@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

8c1c81a3

[Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support (#24845) · cc1dc7ed

Lucas Wilkinson authored Sep 23, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

cc1dc7ed

[XPU] Fix MOE DP accuracy issue on XPU (#25465) · 4c966e44
Fanli Lin authored Sep 23, 2025

4c966e44

18 Sep, 2025 3 commits

Enable Allgather/ReduceScatter backend for NaiveAllToAll (#23964) · 2ea50e97

Shu Wang authored Sep 18, 2025


Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Shu Wang <shuw@nvidia.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

2ea50e97

[Docs] Fix warnings in mkdocs build (continued) (#25163) · b419937c
Hyogeun Oh (오효근) authored Sep 19, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
b419937c

[Doc] Fix cross-reference warnings (#25058) · 05b044e6

Punitvara authored Sep 18, 2025

Signed-off-by: Punit Vara <punitvara@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

05b044e6

16 Sep, 2025 1 commit

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) · 56793995

Sage Moore authored Sep 16, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

56793995

12 Sep, 2025 1 commit
- [Core] Shared memory based object store for Multimodal data caching and IPC (#20452) · a5b84f1c
  dongluw authored Sep 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  a5b84f1c
11 Sep, 2025 1 commit
- [Kernels] Enable Torch Symmetric Memory All-Reduce By Default (#24111) · 1fdd5c42
  Ilya Markov authored Sep 11, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  1fdd5c42