Commits · 8c10743e167edadbb9490f1ff9ff1de5ce9dbf25 · OpenDAS / vllm_cscc

06 Oct, 2025 1 commit
- modify engied_id str · 4bb8c6af
  yangshj1 authored Oct 06, 2025
  
  4bb8c6af
29 Sep, 2025 1 commit
- fix pp error and update min_block_size · 484fcfca
  zhuwenwen authored Sep 29, 2025
  
  484fcfca
26 Sep, 2025 1 commit
- add PD P do pp · ecd5815f
  xiabo authored Sep 26, 2025
  
  ecd5815f
24 Sep, 2025 2 commits
- add env · c6b7a44b
  yangshj1 authored Sep 24, 2025
  
  c6b7a44b
- add engine id · f6fcc8ff
  xuxz authored Sep 24, 2025
  
  f6fcc8ff
22 Sep, 2025 1 commit
- 修改P等待问题 · 560ffc4c
  xiabo authored Sep 22, 2025
  
  560ffc4c
17 Sep, 2025 1 commit
- fix the performance issue of tbo pd separation · f8985b96
  lizhigong authored Sep 17, 2025
  
  f8985b96
16 Sep, 2025 2 commits
- get_lmcache_connector __init__ · 9129c728
  xuxz authored Sep 17, 2025
  
  9129c728
- add pd lmcache · f4fd3a96
  yangshj1 authored Sep 16, 2025
  
  f4fd3a96
15 Sep, 2025 1 commit
- remove logger.warning · 5eec6110
  zhuwenwen authored Sep 15, 2025
  
  5eec6110
14 Sep, 2025 1 commit
- 完善释放包括cpu和tensor_id释放 · bfe12894
  xuxzh1 authored Sep 14, 2025
  
  bfe12894
06 Sep, 2025 1 commit
- [P/D][Feature]显存调度优化，及时释放tensor · ed392378
  zhuwenwen authored Sep 06, 2025
  
  ed392378
30 Jul, 2025 1 commit
- Merge v0.9.2-dev-disagg into v0.9.2-dev · af27c177
  xuxz authored Jul 30, 2025
  
  af27c177
04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
03 Jul, 2025 2 commits
- [Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache... · 8d775dd3
  Nicolò Lucchesi authored Jul 03, 2025
```
[Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache layout` warning (#20400)
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8d775dd3
- [Misc] adjust for ipv6 for mookcacke url parse (#20107) · 1dba2c4e
  Ning Xie authored Jul 04, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  1dba2c4e
01 Jul, 2025 2 commits
- [Optimization] Cache sampled token ids in model runner (#20291) · 7f280d69
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f280d69
- [Misc] Minor refactor of NIXL background handshake (#20068) · 650d5dbd
  Nicolò Lucchesi authored Jul 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  650d5dbd
30 Jun, 2025 2 commits
- [Bugfix][V1][P/D]Fix the issue of occasional garbled output for P2pNcclConnector (#20263) · ded1fb63
  Zhonghua Deng authored Jul 01, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  ded1fb63
- [Optimization] Use Shared `CachedRequestData` Instance Across All Requests (#20232) · 2863befc
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2863befc
26 Jun, 2025 1 commit
- [PD] Skip `tp_size` exchange with rank0 (#19413) · 25826835
  Nicolò Lucchesi authored Jun 26, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  25826835
25 Jun, 2025 1 commit
- [P/D] Avoid stranding blocks in P when aborted in D's waiting queue (#19223) · 55c65ab4
  Nick Hill authored Jun 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  55c65ab4
24 Jun, 2025 1 commit

[P/D] Asynchronously do _nixl_handshake (#19836) · 91f7d9d0

lkchen authored Jun 24, 2025


Signed-off-by: Linkun Chen <github@lkchen.net>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

91f7d9d0

23 Jun, 2025 3 commits
- [Misc] Add type alias `ReqId` and `EngineId` for better readability (#19880) · d0132f02
  lkchen authored Jun 23, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  d0132f02
- [BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when... · 1bcd15ed
  lkchen authored Jun 22, 2025
```
[BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when *all* transfer done (#19874)
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  1bcd15ed
- [P/D][NixlConnector] Support `tp_size > num_kv_heads` deployments (#19691) · 2ebff5b7
  Nicolò Lucchesi authored Jun 23, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  2ebff5b7
18 Jun, 2025 1 commit
- [V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242) · eccdc831
  Zhonghua Deng authored Jun 18, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  eccdc831
17 Jun, 2025 2 commits
- [Misc] Update lmcache connector with the latest connector apis (#19441) · cda92307
  Jiayi Yao authored Jun 17, 2025
```
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
```
  cda92307
- [V1][Kernel] Flashinfer HND KV cache layout (#19280) · 4c8f64fa
  Nicolò Lucchesi authored Jun 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  4c8f64fa
12 Jun, 2025 1 commit
- [V1][NixlConnector] Drop `num_blocks` check (#19532) · 1129e2b1
  Nicolò Lucchesi authored Jun 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  1129e2b1
06 Jun, 2025 2 commits
- [BugFix] Fix MultiConnector test after HMA changes (#19291) · aad30bd3
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  aad30bd3
- [Docs] Improve V1 KVConnector interface documentation (#19172) · 65c69444
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  65c69444
05 Jun, 2025 2 commits
- [P/D][NixlConnector] Enable FlashInfer backend (#19090) · 9ef9173c
  Nicolò Lucchesi authored Jun 05, 2025
  
  9ef9173c
- [Bugfix][Nixl] Fix full prefix cache hit bug (#18632) · c56ed8bb
  Robert Shaw authored Jun 04, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  c56ed8bb
04 Jun, 2025 1 commit
- [P/D] Heterogeneous TP (#18833) · b2fac671
  Nicolò Lucchesi authored Jun 05, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  b2fac671
03 Jun, 2025 2 commits
- [Bugfix][P/D] Fix Prefix Cache Bug (#18411) · 5d96533e
  Nicolò Lucchesi authored Jun 04, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  5d96533e
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
02 Jun, 2025 1 commit
- [Bugfix][Nixl] Fix DP Metadata Handshake (#19008) · b9f61e13
  Robert Shaw authored Jun 01, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  b9f61e13
31 May, 2025 1 commit
- [P/D] NixlConnector use cache device index for memory registration (#18969) · 8bf507d7
  ptarasiewiczNV authored May 31, 2025
```
Signed-off-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
```
  8bf507d7
29 May, 2025 1 commit
- [P/D] NixlConnector DP fixes (#18903) · 64eaf5fe
  Will Eaton authored May 29, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
  64eaf5fe