Commits · 54e42b72dbf7ec259de1c28e66ea9575fe594685 · OpenDAS / vllm_cscc

24 Sep, 2025 2 commits

Support mnnvl all2allv from Flashinfer (#21003) · 54e42b72

Shu Wang authored Sep 24, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

54e42b72

[misc] update the warning message (#25566) · b67dece2
youkaichao authored Sep 24, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
b67dece2

23 Sep, 2025 8 commits

Remove redundant mutates_args and dispatch_key for direct_register_custom_op (#25512) · 7361ab37
Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
7361ab37
[V0 Deprecation] Remove placeholder attn (#25510) · 969b4da3
Thomas Parnell authored Sep 24, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
969b4da3
Enable symmetric memory all reduce by default only enabling for TP (#25070) · 8bdd8b5c
Ilya Markov authored Sep 23, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
8bdd8b5c

[core] add nccl symmetric memory for all reduce (#24532) · 8c1c81a3

Amir Samani authored Sep 23, 2025


Signed-off-by: Amir Samani <asamani@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

8c1c81a3

[Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support (#24845) · cc1dc7ed

Lucas Wilkinson authored Sep 23, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

cc1dc7ed

[XPU] Fix MOE DP accuracy issue on XPU (#25465) · 4c966e44
Fanli Lin authored Sep 23, 2025

4c966e44
[P/D] Support NIXL connector to disconnect during a clean shutdown (#24423) · f05a4f0e
Chauncey authored Sep 23, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
f05a4f0e
[NIXL][OOT platform] support nixl_connector with oot platform and other nixl_backend (#25121) · 5774b0a1
Chendi.Xue authored Sep 22, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
5774b0a1

22 Sep, 2025 2 commits

[DP] support torchrun external launcher with Data Parallelism (#24899) · 922979bf

Lucia Fang authored Sep 22, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

922979bf

[Bugfix] Fix several issues with p2p xPyD in GET type (#23993) · c10101a3

Csrayz authored Sep 22, 2025


Signed-off-by: Csrayz <jover@cmbchina.com>
Signed-off-by: ivyilike <pww123@cmbchina.com>
Co-authored-by: ivyilike <pww123@cmbchina.com>

c10101a3

21 Sep, 2025 1 commit
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
20 Sep, 2025 1 commit

[BugFix] Ensure appropriate guards in destructors (#25284) · a25ade5d

Nick Hill authored Sep 19, 2025


Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

a25ade5d

19 Sep, 2025 2 commits
- [KV offload][4/N] Offloading KV connector (#22595) · c59a0eca
  Or Ozeri authored Sep 19, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  c59a0eca
- [P/D][Nixl] Introduce `KVTransferMetrics` and aggregation strategy (#22188) · a3d087ad
  Nicolò Lucchesi authored Sep 19, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  a3d087ad
18 Sep, 2025 3 commits

Enable Allgather/ReduceScatter backend for NaiveAllToAll (#23964) · 2ea50e97

Shu Wang authored Sep 18, 2025


Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Shu Wang <shuw@nvidia.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

2ea50e97

[Docs] Fix warnings in mkdocs build (continued) (#25163) · b419937c
Hyogeun Oh (오효근) authored Sep 19, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
b419937c

[Doc] Fix cross-reference warnings (#25058) · 05b044e6

Punitvara authored Sep 18, 2025

Signed-off-by: Punit Vara <punitvara@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

05b044e6

17 Sep, 2025 1 commit
- [Docs] improve code formatting and comments for eliminate griffe build warning. (#25010) · 47f670b0
  samzong authored Sep 17, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  47f670b0
16 Sep, 2025 2 commits

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) · 56793995

Sage Moore authored Sep 16, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

56793995

[Bugfix] Fix sequence parallelism bug when enable pipeline parallelism (#24021) · 17871983
cascade authored Sep 15, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
17871983

15 Sep, 2025 2 commits
- [XPU] Set consistent default KV cache layout (#24745) · 2e41f5ab
  Nicolò Lucchesi authored Sep 15, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2e41f5ab
- [P/D]`kv_output_aggregator` support P TP > D TP (#23917) · 8de261b0
  Chao Lei authored Sep 15, 2025
```
Signed-off-by: LCAIZJ <leichao139636@163.com>
Co-authored-by: leichao.lc <leichao.lc@antgroup.com>
```
  8de261b0
13 Sep, 2025 2 commits
- Remove redundant assignment in xfer_buffers, This is a little fix (#24732) · 15b8fef4
  TaoYu Chen authored Sep 13, 2025
```
Signed-off-by: ChenTaoyu-SJTU <ctynb@qq.com>
```
  15b8fef4
- [Docs] Fix warnings in mkdocs build (continued) (#24791) · 9a8966bc
  Hyogeun Oh (오효근) authored Sep 13, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  9a8966bc
12 Sep, 2025 2 commits
- [Core] Shared memory based object store for Multimodal data caching and IPC (#20452) · a5b84f1c
  dongluw authored Sep 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  a5b84f1c
- [Multimodal] Remove legacy multimodal fields in favor of MultiModalFeatureSpec (#24548) · 0377802c
  Flora Feng authored Sep 12, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  0377802c
11 Sep, 2025 1 commit
- [Kernels] Enable Torch Symmetric Memory All-Reduce By Default (#24111) · 1fdd5c42
  Ilya Markov authored Sep 11, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  1fdd5c42
10 Sep, 2025 3 commits
- [Misc] Make timeout passable in init_distributed_environment (#24522) · cc99baf1
  Jonathan Berkhahn authored Sep 10, 2025
```
Signed-off-by: jberkhahn <jaberkha@us.ibm.com>
```
  cc99baf1
- [P/D] MultiConnector supports shutdown (#24425) · 309d7aa4
  Chauncey authored Sep 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  309d7aa4
- [KV Connector] More async support for `get_num_new_matched_tokens` (#23620) · b4a01aaf
  Yihua Cheng authored Sep 09, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  b4a01aaf
09 Sep, 2025 3 commits
- [Doc]: fixing typos to improve docs (#24480) · 46876dff
  Didier Durand authored Sep 09, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  46876dff
- [Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673) · 82dfb12e
  Zebing Lin authored Sep 09, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  82dfb12e
- Move `KVTransferConfig` from `config/__init__.py` to `config/kv_transfer.py` (#24434) · 3e0d4a34
  Harry Mellor authored Sep 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3e0d4a34
08 Sep, 2025 3 commits
- Move `KVEventsConfig` from `config/__init__.py` to `config/kv_events.py` (#24433) · 03dd652c
  Harry Mellor authored Sep 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  03dd652c
- [Doc]: fix typos in Python comments (#24417) · f4962a6d
  Didier Durand authored Sep 08, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  f4962a6d
- [P/D] Add a shutdown method to the Connector API (#22699) · 61aa4b29
  Chauncey authored Sep 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  61aa4b29
06 Sep, 2025 2 commits

[V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
4172235a

[Feature] Support Decode Context Parallel (DCP) for MLA (#23734) · ac201a0e

yzds authored Sep 06, 2025


Signed-off-by: hongchao <hongchao@msh.team>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: youkaichao <youkaichao@gmail.com>

ac201a0e