Commits · d411df029648ff8107bddf89594b101879960491 · OpenDAS / vllm_cscc

10 Aug, 2025 1 commit
- [Misc] Further refine type annotations in parallel state (#22499) · d411df02
  Cyrus Leung authored Aug 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d411df02
09 Aug, 2025 1 commit
- v1: Pass KVConnectorOutput to scheduler-side (#22157) · 7ad7adb6
  Or Ozeri authored Aug 09, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7ad7adb6
08 Aug, 2025 2 commits
- [Misc] Begin deprecation of `get_tensor_model_*_group` (#22494) · 43c4f3d7
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  43c4f3d7
- Fix Flashinfer CUTLASS MOE Allgather (#21963) · b2c8ce57
  Shu Wang authored Aug 07, 2025
```
Signed-off-by: Shu Wang <shuw@nvidia.com>
```
  b2c8ce57
07 Aug, 2025 1 commit

[Bugfix] EPLB load statistics problem (#22167) · 4be02a37

WeiQing Chen authored Aug 07, 2025


Signed-off-by: ycyaw66 <497410282@qq.com>
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>

4be02a37

05 Aug, 2025 4 commits
- [Misc] correct static type check for GroupCoordinator (#21946) · 74333ae2
  Ning Xie authored Aug 05, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  74333ae2
- [Misc] log more detailed message for ensure_model_parallel_initialized (#22144) · bd3db7f4
  Ning Xie authored Aug 05, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  bd3db7f4
- [Doc] add backend to doc string of initialize_model_parallel (#22142) · 29b97c09
  Ning Xie authored Aug 05, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  29b97c09
- [V0 deprecation][P/D] Deprecate v0 `KVConnectorBase` code (1/2) (#21785) · f4f4e7ef
  lkchen authored Aug 04, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  f4f4e7ef
04 Aug, 2025 1 commit
- remove duplicate code within cleanup_dist_env_and_memory (#22147) · c2e75b3c
  Ning Xie authored Aug 04, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c2e75b3c
03 Aug, 2025 2 commits
- [V1] [P/D] Refactor KV Connector Path (#21980) · aefeea0f
  David Ben-David authored Aug 03, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  aefeea0f
- [Misc] update doc comment for send (#22026) · 7de45db9
  Ning Xie authored Aug 03, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  7de45db9
01 Aug, 2025 1 commit
- Introduce RayPPCommunicator for ray-based PP (#21660) · d3317594
  Rui Qiao authored Aug 01, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  d3317594
30 Jul, 2025 2 commits
- feat(distributed): add `get_required_kvcache_layout` class method to kv connector api (#20433) · f4135232
  wxsm authored Jul 31, 2025
```
Signed-off-by: wxsm <wxsms@foxmail.com>
```
  f4135232
- [Bugfix] SharedStorage Connector for V1 PD multimodal (#21611) · 4904e53c
  Chenguang Zheng authored Jul 31, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
```
  4904e53c
29 Jul, 2025 1 commit
- skip fusedmoe layer for start_load_kv (#21378) · e18f0851
  Calvin Chen authored Jul 29, 2025
```
Signed-off-by: calvin chen <wen.chen@dynamia.ai>
```
  e18f0851
28 Jul, 2025 3 commits
- Revert "[V1] Exception Handling when Loading KV Cache from Remote Store" (#21778) · b18b417f
  Kuntai Du authored Jul 28, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  b18b417f
- [P/D] Log warnings related to prefill KV expiry (#21753) · 7d44c691
  Nick Hill authored Jul 28, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7d44c691
- [V1] Exception Handling when Loading KV Cache from Remote Store (#21534) · 15a72ac4
  Adeline authored Jul 28, 2025
```
Signed-off-by: liuyumoye <adeline_ly2023@outlook.com>
Co-authored-by: liuyumoye <adeline_ly2023@outlook.com>
```
  15a72ac4
26 Jul, 2025 1 commit
- [BugFix] Fix shared storage connector load kv only load attention layer (#21428) · 97d6c30c
  WeiQing Chen authored Jul 26, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
  97d6c30c
24 Jul, 2025 2 commits

[P/D] Support CPU Transfer in NixlConnector (#18293) · 60662849

Juncheng Gu authored Jul 24, 2025


Signed-off-by: Juncheng Gu <juncgu@gmail.com>
Signed-off-by: Richard Liu <ricliu@google.com>
Co-authored-by: Richard Liu <39319471+richardsliu@users.noreply.github.com>
Co-authored-by: Richard Liu <ricliu@google.com>

60662849

[P/D] Move FakeNixlWrapper to test dir (#21328) · 1e9ea8e6
Rui Qiao authored Jul 24, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
1e9ea8e6

21 Jul, 2025 1 commit
- [CPU] Enable shared-memory based pipeline parallel for CPU backend (#21289) · a15a50fc
  Li, Jiang authored Jul 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a15a50fc
19 Jul, 2025 2 commits
- [BugFix] Make PD work with Ray (#21072) · 9f414a12
  kourosh hakhamaneshi authored Jul 19, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  9f414a12
- Elastic Expert Parallel Initial Support (#20775) · 21793722
  Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  21793722
17 Jul, 2025 2 commits
- [V0 deprecation] Remove V0 HPU backend (#21131) · 4de71463
  Woosuk Kwon authored Jul 17, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4de71463
- [V1][P/D]Enhance Performance and code readability for P2pNcclConnector (#20906) · 8a4e5c5f
  Zhonghua Deng authored Jul 17, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  8a4e5c5f
12 Jul, 2025 1 commit

Add pynccl all-gatherv and reducescatterv (#20154) · a8593237

Trevor Morris authored Jul 11, 2025


Signed-off-by: Trevor Morris <tmorris@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

a8593237

11 Jul, 2025 1 commit
- [Misc] Add unit tests for MoE ModularKernel combinations + Profiling utility (#20449) · 53fa4573
  Varun Sundar Rabindranath authored Jul 11, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  53fa4573
10 Jul, 2025 2 commits
- [KVConnector] Always call connector `clear_metadata()` at end of step (#20756) · 574ad60d
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: David Ben-David <sdavidbd@gmail.com>
```
  574ad60d
- [KVConnector] Aggregate finished requests on the scheduler (#19555) · cc876d0f
  Or Ozeri authored Jul 10, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  cc876d0f
09 Jul, 2025 2 commits

[BugFix]: Properly set engine_id when using multi connector (#19487) · cd587c93

Yiming authored Jul 10, 2025


Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: leiyiming <leiyiming@kingsoft.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

cd587c93

[XPU][CI] enhance xpu test support (#20652) · a3e4e85e

Liangliang Ma authored Jul 10, 2025


Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
Co-authored-by: zhenwei-intel <zhenweiliu@habana.ai>

a3e4e85e

08 Jul, 2025 1 commit
- [PD][Nixl] Remote consumer READ timeout for clearing request blocks (#20139) · 71d1d75b
  Nicolò Lucchesi authored Jul 08, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  71d1d75b
04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
03 Jul, 2025 2 commits
- [Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache... · 8d775dd3
  Nicolò Lucchesi authored Jul 03, 2025
```
[Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache layout` warning (#20400)
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8d775dd3
- [Misc] adjust for ipv6 for mookcacke url parse (#20107) · 1dba2c4e
  Ning Xie authored Jul 04, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  1dba2c4e
01 Jul, 2025 3 commits
- [Optimization] Cache sampled token ids in model runner (#20291) · 7f280d69
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f280d69
- [Misc] Minor refactor of NIXL background handshake (#20068) · 650d5dbd
  Nicolò Lucchesi authored Jul 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  650d5dbd
- [V1] Only print cudagraph tqdm on rank 0 with `is_global_first_rank` (#19516) · be250bbc
  Michael Goin authored Jul 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  be250bbc