Commits · eb58f5953de8af1b02e4319519d6b9b806b1bbff · OpenDAS / vllm_cscc

08 Jul, 2025 1 commit
- [PD][Nixl] Remote consumer READ timeout for clearing request blocks (#20139) · 71d1d75b
  Nicolò Lucchesi authored Jul 08, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  71d1d75b
04 Jul, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
03 Jul, 2025 2 commits
- [Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache... · 8d775dd3
  Nicolò Lucchesi authored Jul 03, 2025
```
[Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache layout` warning (#20400)
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8d775dd3
- [Misc] adjust for ipv6 for mookcacke url parse (#20107) · 1dba2c4e
  Ning Xie authored Jul 04, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  1dba2c4e
01 Jul, 2025 3 commits
- [Optimization] Cache sampled token ids in model runner (#20291) · 7f280d69
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f280d69
- [Misc] Minor refactor of NIXL background handshake (#20068) · 650d5dbd
  Nicolò Lucchesi authored Jul 01, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  650d5dbd
- [V1] Only print cudagraph tqdm on rank 0 with `is_global_first_rank` (#19516) · be250bbc
  Michael Goin authored Jul 01, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  be250bbc
30 Jun, 2025 2 commits
- [Bugfix][V1][P/D]Fix the issue of occasional garbled output for P2pNcclConnector (#20263) · ded1fb63
  Zhonghua Deng authored Jul 01, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  ded1fb63
- [Optimization] Use Shared `CachedRequestData` Instance Across All Requests (#20232) · 2863befc
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2863befc
28 Jun, 2025 1 commit

[Refactor] Create a function util and cache the results for `has_deepgemm`,... · 4d366936

Wentao Ye authored Jun 28, 2025


[Refactor] Create a function util and cache the results for `has_deepgemm`, `has_deepep`, `has_pplx` (#20187)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

4d366936

27 Jun, 2025 1 commit

[Feature] add quick all reduce (#19744) · 0740e29b

li haoyang authored Jun 27, 2025


Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>

0740e29b

26 Jun, 2025 2 commits
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
- [PD] Skip `tp_size` exchange with rank0 (#19413) · 25826835
  Nicolò Lucchesi authored Jun 26, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  25826835
25 Jun, 2025 2 commits
- [P/D] Avoid stranding blocks in P when aborted in D's waiting queue (#19223) · 55c65ab4
  Nick Hill authored Jun 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  55c65ab4
- [Misc] Add parallel state `node_count` function (#20045) · c40692bf
  Nick Hill authored Jun 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c40692bf
24 Jun, 2025 1 commit

[P/D] Asynchronously do _nixl_handshake (#19836) · 91f7d9d0

lkchen authored Jun 24, 2025


Signed-off-by: Linkun Chen <github@lkchen.net>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

91f7d9d0

23 Jun, 2025 3 commits
- [Misc] Add type alias `ReqId` and `EngineId` for better readability (#19880) · d0132f02
  lkchen authored Jun 23, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  d0132f02
- [BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when... · 1bcd15ed
  lkchen authored Jun 22, 2025
```
[BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when *all* transfer done (#19874)
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  1bcd15ed
- [P/D][NixlConnector] Support `tp_size > num_kv_heads` deployments (#19691) · 2ebff5b7
  Nicolò Lucchesi authored Jun 23, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  2ebff5b7
18 Jun, 2025 1 commit
- [V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242) · eccdc831
  Zhonghua Deng authored Jun 18, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  eccdc831
17 Jun, 2025 3 commits
- [Misc] Update lmcache connector with the latest connector apis (#19441) · cda92307
  Jiayi Yao authored Jun 17, 2025
```
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
```
  cda92307
- [V1][Kernel] Flashinfer HND KV cache layout (#19280) · 4c8f64fa
  Nicolò Lucchesi authored Jun 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  4c8f64fa
- [Fix] Fall back to Gloo when NCCL backend is unavailable (#19641) · 0860087a
  Conroy Cheers authored Jun 17, 2025
```
Signed-off-by: conroy-cheers <conroy@corncheese.org>
```
  0860087a
12 Jun, 2025 1 commit
- [V1][NixlConnector] Drop `num_blocks` check (#19532) · 1129e2b1
  Nicolò Lucchesi authored Jun 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  1129e2b1
09 Jun, 2025 1 commit
- [Misc] Fixes and Optimizations for DeepEP + DeepGEMM combination. (#19298) · 5cf2daea
  Varun Sundar Rabindranath authored Jun 09, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  5cf2daea
06 Jun, 2025 2 commits
- [BugFix] Fix MultiConnector test after HMA changes (#19291) · aad30bd3
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  aad30bd3
- [Docs] Improve V1 KVConnector interface documentation (#19172) · 65c69444
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  65c69444
05 Jun, 2025 3 commits
- [P/D][NixlConnector] Enable FlashInfer backend (#19090) · 9ef9173c
  Nicolò Lucchesi authored Jun 05, 2025
  
  9ef9173c
- [MISC][Bugfix] Use less CPU when message queue has been empty for some time (#16226) · 85e2b7bb
  Povilas Kanapickas authored Jun 05, 2025
```
Signed-off-by: Povilas Kanapickas <povilas@radix.lt>
```
  85e2b7bb
- [Bugfix][Nixl] Fix full prefix cache hit bug (#18632) · c56ed8bb
  Robert Shaw authored Jun 04, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  c56ed8bb
04 Jun, 2025 3 commits
- [P/D] Heterogeneous TP (#18833) · b2fac671
  Nicolò Lucchesi authored Jun 05, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  b2fac671
- [Bugfix][EP+DP] Fix internode check (#19112) · d459fae0
  Tyler Michael Smith authored Jun 04, 2025
```
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
```
  d459fae0
- feat: add data parallel rank to KVEventBatch (#18925) · b712be98
  Yan Ru Pei authored Jun 03, 2025
  
  b712be98
03 Jun, 2025 6 commits
- [Bugfix][P/D] Fix Prefix Cache Bug (#18411) · 5d96533e
  Nicolò Lucchesi authored Jun 04, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  5d96533e
- [Kernel] DeepEP dispatch-combine kernel integration (#18434) · fa98d777
  Varun Sundar Rabindranath authored Jun 03, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fa98d777
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [CPU][CI] Re-enable the CPU CI tests (#19046) · 8655f47f
  Li, Jiang authored Jun 03, 2025
```
Signed-off-by: jiang.li <jiang1.li@intel.com>
```
  8655f47f
- [Bugfix][EP+DP] Use pplx-kernel internode instead of intranode (#19034) · 8a57872b
  Tyler Michael Smith authored Jun 02, 2025
```
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8a57872b
- [Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011) · 9112b443
  Siyuan Liu authored Jun 02, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: Hossein Sarshar <hossein.sarshar@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  9112b443
02 Jun, 2025 1 commit
- [Bugfix][Nixl] Fix DP Metadata Handshake (#19008) · b9f61e13
  Robert Shaw authored Jun 01, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  b9f61e13