Commits · f4fd3a96ec48dd8f3889504e606c459f6ad18b69 · OpenDAS / vllm_cscc · GitLab

16 Sep, 2025 1 commit
- add pd lmcache · f4fd3a96
  yangshj1 authored Sep 16, 2025
  
  f4fd3a96
15 Sep, 2025 1 commit
- remove logger.warning · 5eec6110
  zhuwenwen authored Sep 15, 2025
  
  5eec6110
14 Sep, 2025 1 commit
- 完善释放包括cpu和tensor_id释放 · bfe12894
  xuxzh1 authored Sep 14, 2025
  
  bfe12894
06 Sep, 2025 1 commit
- [P/D][Feature]显存调度优化，及时释放tensor · ed392378
  zhuwenwen authored Sep 06, 2025
  
  ed392378
30 Jul, 2025 1 commit
- Merge v0.9.2-dev-disagg into v0.9.2-dev · af27c177
  xuxz authored Jul 30, 2025
  
  af27c177
04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
03 Jul, 2025 2 commits
- [Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache... · 8d775dd3
  Nicolò Lucchesi authored Jul 03, 2025
```
[Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache layout` warning (#20400)
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8d775dd3
- [Misc] adjust for ipv6 for mookcacke url parse (#20107) · 1dba2c4e
  Ning Xie authored Jul 04, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  1dba2c4e
01 Jul, 2025 2 commits
- [Optimization] Cache sampled token ids in model runner (#20291) · 7f280d69
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f280d69
- [Misc] Minor refactor of NIXL background handshake (#20068) · 650d5dbd
  Nicolò Lucchesi authored Jul 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  650d5dbd
30 Jun, 2025 2 commits
- [Bugfix][V1][P/D]Fix the issue of occasional garbled output for P2pNcclConnector (#20263) · ded1fb63
  Zhonghua Deng authored Jul 01, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  ded1fb63
- [Optimization] Use Shared `CachedRequestData` Instance Across All Requests (#20232) · 2863befc
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2863befc
26 Jun, 2025 1 commit
- [PD] Skip `tp_size` exchange with rank0 (#19413) · 25826835
  Nicolò Lucchesi authored Jun 26, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  25826835
25 Jun, 2025 1 commit
- [P/D] Avoid stranding blocks in P when aborted in D's waiting queue (#19223) · 55c65ab4
  Nick Hill authored Jun 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  55c65ab4
24 Jun, 2025 1 commit

[P/D] Asynchronously do _nixl_handshake (#19836) · 91f7d9d0

lkchen authored Jun 24, 2025


Signed-off-by: Linkun Chen <github@lkchen.net>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

91f7d9d0

23 Jun, 2025 3 commits
- [Misc] Add type alias `ReqId` and `EngineId` for better readability (#19880) · d0132f02
  lkchen authored Jun 23, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  d0132f02
- [BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when... · 1bcd15ed
  lkchen authored Jun 22, 2025
```
[BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when *all* transfer done (#19874)
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  1bcd15ed
- [P/D][NixlConnector] Support `tp_size > num_kv_heads` deployments (#19691) · 2ebff5b7
  Nicolò Lucchesi authored Jun 23, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  2ebff5b7
18 Jun, 2025 1 commit
- [V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242) · eccdc831
  Zhonghua Deng authored Jun 18, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  eccdc831
17 Jun, 2025 2 commits
- [Misc] Update lmcache connector with the latest connector apis (#19441) · cda92307
  Jiayi Yao authored Jun 17, 2025
```
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
```
  cda92307
- [V1][Kernel] Flashinfer HND KV cache layout (#19280) · 4c8f64fa
  Nicolò Lucchesi authored Jun 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  4c8f64fa
12 Jun, 2025 1 commit
- [V1][NixlConnector] Drop `num_blocks` check (#19532) · 1129e2b1
  Nicolò Lucchesi authored Jun 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  1129e2b1
06 Jun, 2025 2 commits
- [BugFix] Fix MultiConnector test after HMA changes (#19291) · aad30bd3
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  aad30bd3
- [Docs] Improve V1 KVConnector interface documentation (#19172) · 65c69444
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  65c69444
05 Jun, 2025 2 commits
- [P/D][NixlConnector] Enable FlashInfer backend (#19090) · 9ef9173c
  Nicolò Lucchesi authored Jun 05, 2025
  
  9ef9173c
- [Bugfix][Nixl] Fix full prefix cache hit bug (#18632) · c56ed8bb
  Robert Shaw authored Jun 04, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  c56ed8bb
04 Jun, 2025 1 commit
- [P/D] Heterogeneous TP (#18833) · b2fac671
  Nicolò Lucchesi authored Jun 05, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  b2fac671
03 Jun, 2025 2 commits
- [Bugfix][P/D] Fix Prefix Cache Bug (#18411) · 5d96533e
  Nicolò Lucchesi authored Jun 04, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  5d96533e
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
02 Jun, 2025 1 commit
- [Bugfix][Nixl] Fix DP Metadata Handshake (#19008) · b9f61e13
  Robert Shaw authored Jun 01, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  b9f61e13
31 May, 2025 1 commit
- [P/D] NixlConnector use cache device index for memory registration (#18969) · 8bf507d7
  ptarasiewiczNV authored May 31, 2025
```
Signed-off-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
```
  8bf507d7
29 May, 2025 1 commit
- [P/D] NixlConnector DP fixes (#18903) · 64eaf5fe
  Will Eaton authored May 29, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
  64eaf5fe
27 May, 2025 1 commit
- Minor fix about MooncakeStoreConnector (#18721) · c24b1572
  maobaolong authored May 27, 2025
```
Signed-off-by: baoloongmao <baoloongmao@tencent.com>
```
  c24b1572
24 May, 2025 1 commit
- [MISC] typo fix and clean import (#18664) · 4ceafb62
  Ning Xie authored May 24, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  4ceafb62
23 May, 2025 3 commits
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- [v1] Redo "Support multiple KV cache groups in GPU model runner (#17945)" (#18593) · 6550114c
  Chen Zhang authored May 24, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6550114c
- [Bugfix] Set `KVTransferConfig.engine_id` in post_init (#18576) · e44d8ce8
  lkchen authored May 22, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  e44d8ce8
21 May, 2025 3 commits
- Revert "[v1] Support multiple KV cache groups in GPU model runner (#17945) (#18459) · bb0a3112
  Mark McLoughlin authored May 21, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  bb0a3112
- [Misc] MultiConnector._connectors type (#18423) · cd8dfc6d
  Nicolò Lucchesi authored May 21, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  cd8dfc6d
- [Bugfix][Failing Test] Fix nixl connector test when promt size < block size (#18429) · d06dd72b
  wwl2755 authored May 21, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  d06dd72b