Commits · a99300bda69edba0082a9038143ecd66de4d078b · OpenDAS / vllm_cscc

07 Sep, 2025 1 commit
- [P/D][Feature]显存调度优化，及时释放tensor · cc3e01c7
  zhuwenwen authored Sep 07, 2025
  
  cc3e01c7
01 Sep, 2025 1 commit
- v1: Support KV events from connectors (#19737) · 14b4326b
  Or Ozeri authored Sep 01, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  14b4326b
30 Aug, 2025 1 commit
- [Misc] enhance type hint for rearrange return value (#23519) · 68a34911
  Ning Xie authored Aug 30, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  68a34911
29 Aug, 2025 1 commit
- [XPU] support data parallel for MoE models on XPU (#22887) · 235c9db8
  Chaojun Zhang authored Aug 29, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  235c9db8
27 Aug, 2025 2 commits
- DP/EP Support for gpt-oss with deepep-ht comm kernel on SM100 (#23608) · 082cc07e
  Yongye Zhu authored Aug 27, 2025
  
  082cc07e
- fix pynccl reduce_scatter (#23648) · c7c80af0
  yzds authored Aug 27, 2025
```
Co-authored-by: hongchao <hongchao@msh.team>
```
  c7c80af0
26 Aug, 2025 2 commits
- [V1][P/D]P2pNcclConnector supports flashinfer (#23536) · c3b0fd1e
  Zhonghua Deng authored Aug 27, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c3b0fd1e
- [Doc]: fix various spelling issues in multiple files (#23636) · 7c04779a
  Didier Durand authored Aug 26, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7c04779a
25 Aug, 2025 1 commit

[Bugfix][V1][P/D]Fix the issue where repeated requests for the same input... · 9188ae7c

Zhonghua Deng authored Aug 26, 2025


[Bugfix][V1][P/D]Fix the issue where repeated requests for the same input produce abnormal outputs for P2pNcclConnector (#23403)
Signed-off-by: Abatom <abzhonghua@gmail.com>

9188ae7c

22 Aug, 2025 2 commits

[PERF] PyTorch Symmetric Memory All-Reduce (#20759) · 0313cf85

Ilya Markov authored Aug 22, 2025


Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

0313cf85

[P/D][Nixl] Make kv cache register compatible with hybrid memory allocator (#23079) · 53415653
Flora Feng authored Aug 21, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
53415653

20 Aug, 2025 1 commit

[Feature] use --eplb_config to set eplb param (#20562) · 4fbda0b2

rongfu.leng authored Aug 21, 2025


Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

4fbda0b2

19 Aug, 2025 1 commit

[TPU] make ptxla not imported when using tpu_commons (#23081) · e9d6a3db

Chengji Yao authored Aug 18, 2025


Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Signed-off-by: Chengji Yao <chengjiyao@google.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>

e9d6a3db

15 Aug, 2025 2 commits

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra... · 8ad7285e

bnellnm authored Aug 15, 2025


[Kernels] Clean up FusedMoeMethodBase and modular kernel setup.  Remove extra arguments from modular kernel methods. (#22035)
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

8ad7285e

[BugFix][KVConn] Fix use of `get_required_kvcache_layout` (#22734) · 0933f9d5
Nick Hill authored Aug 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
0933f9d5

14 Aug, 2025 1 commit

[CI] Fix `tests/distributed/test_ca_buffer_sharing.py` (#22849) · 1d20c347

Ilya Markov authored Aug 14, 2025


Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

1d20c347

12 Aug, 2025 2 commits
- [CI][Nixl] Check kv cache layout during handshake (#22745) · 422f22e0
  Nicolò Lucchesi authored Aug 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  422f22e0
- [BugFix][Nixl][PD] Fix heterogenous TP (#22663) · d030b015
  Nicolò Lucchesi authored Aug 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  d030b015
11 Aug, 2025 1 commit
- fix: NIXL connector transfers partial block to pass full multi-modal context (#21074) · 16fb668b
  GuanLuo authored Aug 11, 2025
```
Signed-off-by: GuanLuo <gluo@nvidia.com>
```
  16fb668b
10 Aug, 2025 1 commit
- [Misc] Further refine type annotations in parallel state (#22499) · d411df02
  Cyrus Leung authored Aug 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d411df02
09 Aug, 2025 1 commit
- v1: Pass KVConnectorOutput to scheduler-side (#22157) · 7ad7adb6
  Or Ozeri authored Aug 09, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7ad7adb6
08 Aug, 2025 2 commits
- [Misc] Begin deprecation of `get_tensor_model_*_group` (#22494) · 43c4f3d7
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  43c4f3d7
- Fix Flashinfer CUTLASS MOE Allgather (#21963) · b2c8ce57
  Shu Wang authored Aug 07, 2025
```
Signed-off-by: Shu Wang <shuw@nvidia.com>
```
  b2c8ce57
07 Aug, 2025 1 commit

[Bugfix] EPLB load statistics problem (#22167) · 4be02a37

WeiQing Chen authored Aug 07, 2025


Signed-off-by: ycyaw66 <497410282@qq.com>
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>

4be02a37

05 Aug, 2025 4 commits
- [Misc] correct static type check for GroupCoordinator (#21946) · 74333ae2
  Ning Xie authored Aug 05, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  74333ae2
- [Misc] log more detailed message for ensure_model_parallel_initialized (#22144) · bd3db7f4
  Ning Xie authored Aug 05, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  bd3db7f4
- [Doc] add backend to doc string of initialize_model_parallel (#22142) · 29b97c09
  Ning Xie authored Aug 05, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  29b97c09
- [V0 deprecation][P/D] Deprecate v0 `KVConnectorBase` code (1/2) (#21785) · f4f4e7ef
  lkchen authored Aug 04, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  f4f4e7ef
04 Aug, 2025 1 commit
- remove duplicate code within cleanup_dist_env_and_memory (#22147) · c2e75b3c
  Ning Xie authored Aug 04, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c2e75b3c
03 Aug, 2025 2 commits
- [V1] [P/D] Refactor KV Connector Path (#21980) · aefeea0f
  David Ben-David authored Aug 03, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  aefeea0f
- [Misc] update doc comment for send (#22026) · 7de45db9
  Ning Xie authored Aug 03, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  7de45db9
01 Aug, 2025 1 commit
- Introduce RayPPCommunicator for ray-based PP (#21660) · d3317594
  Rui Qiao authored Aug 01, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  d3317594
30 Jul, 2025 3 commits
- feat(distributed): add `get_required_kvcache_layout` class method to kv connector api (#20433) · f4135232
  wxsm authored Jul 31, 2025
```
Signed-off-by: wxsm <wxsms@foxmail.com>
```
  f4135232
- [Bugfix] SharedStorage Connector for V1 PD multimodal (#21611) · 4904e53c
  Chenguang Zheng authored Jul 31, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
```
  4904e53c
- [Bugfix][P/D]skip fusedmoe layer for start_load_kv · 05c3c3bb
  zhuwenwen authored Jul 30, 2025
```
[Bugfix][P/D]Slove the problem that attn_medadata is not MLACommonMetadata
```
  05c3c3bb
29 Jul, 2025 1 commit
- skip fusedmoe layer for start_load_kv (#21378) · e18f0851
  Calvin Chen authored Jul 29, 2025
```
Signed-off-by: calvin chen <wen.chen@dynamia.ai>
```
  e18f0851
28 Jul, 2025 3 commits
- Revert "[V1] Exception Handling when Loading KV Cache from Remote Store" (#21778) · b18b417f
  Kuntai Du authored Jul 28, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  b18b417f
- [P/D] Log warnings related to prefill KV expiry (#21753) · 7d44c691
  Nick Hill authored Jul 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7d44c691
- [V1] Exception Handling when Loading KV Cache from Remote Store (#21534) · 15a72ac4
  Adeline authored Jul 28, 2025
```
Signed-off-by: liuyumoye <adeline_ly2023@outlook.com>
Co-authored-by: liuyumoye <adeline_ly2023@outlook.com>
```
  15a72ac4
26 Jul, 2025 1 commit
- [BugFix] Fix shared storage connector load kv only load attention layer (#21428) · 97d6c30c
  WeiQing Chen authored Jul 26, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
  97d6c30c