Commits · daec9dea6e9bb95cb12faa38e347196de4f672a0 · OpenDAS / vllm_cscc

27 Jun, 2025 1 commit

[Feature] add quick all reduce (#19744) · 0740e29b

li haoyang authored Jun 27, 2025


Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>

0740e29b

26 Jun, 2025 2 commits
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
- [PD] Skip `tp_size` exchange with rank0 (#19413) · 25826835
  Nicolò Lucchesi authored Jun 26, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  25826835
25 Jun, 2025 2 commits
- [P/D] Avoid stranding blocks in P when aborted in D's waiting queue (#19223) · 55c65ab4
  Nick Hill authored Jun 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  55c65ab4
- [Misc] Add parallel state `node_count` function (#20045) · c40692bf
  Nick Hill authored Jun 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c40692bf
24 Jun, 2025 1 commit

[P/D] Asynchronously do _nixl_handshake (#19836) · 91f7d9d0

lkchen authored Jun 24, 2025


Signed-off-by: Linkun Chen <github@lkchen.net>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

91f7d9d0

23 Jun, 2025 3 commits
- [Misc] Add type alias `ReqId` and `EngineId` for better readability (#19880) · d0132f02
  lkchen authored Jun 23, 2025
```
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  d0132f02
- [BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when... · 1bcd15ed
  lkchen authored Jun 22, 2025
```
[BugFix][P/D] Fix for cases where _recving_transfers can be cleaned up when *all* transfer done (#19874)
Signed-off-by: Linkun Chen <github@lkchen.net>
```
  1bcd15ed
- [P/D][NixlConnector] Support `tp_size > num_kv_heads` deployments (#19691) · 2ebff5b7
  Nicolò Lucchesi authored Jun 23, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  2ebff5b7
18 Jun, 2025 1 commit
- [V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242) · eccdc831
  Zhonghua Deng authored Jun 18, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
```
  eccdc831
17 Jun, 2025 3 commits
- [Misc] Update lmcache connector with the latest connector apis (#19441) · cda92307
  Jiayi Yao authored Jun 17, 2025
```
Signed-off-by: YaoJiayi <120040070@link.cuhk.edu.cn>
```
  cda92307
- [V1][Kernel] Flashinfer HND KV cache layout (#19280) · 4c8f64fa
  Nicolò Lucchesi authored Jun 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  4c8f64fa
- [Fix] Fall back to Gloo when NCCL backend is unavailable (#19641) · 0860087a
  Conroy Cheers authored Jun 17, 2025
```
Signed-off-by: conroy-cheers <conroy@corncheese.org>
```
  0860087a
12 Jun, 2025 1 commit
- [V1][NixlConnector] Drop `num_blocks` check (#19532) · 1129e2b1
  Nicolò Lucchesi authored Jun 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  1129e2b1
09 Jun, 2025 1 commit
- [Misc] Fixes and Optimizations for DeepEP + DeepGEMM combination. (#19298) · 5cf2daea
  Varun Sundar Rabindranath authored Jun 09, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  5cf2daea
06 Jun, 2025 2 commits
- [BugFix] Fix MultiConnector test after HMA changes (#19291) · aad30bd3
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  aad30bd3
- [Docs] Improve V1 KVConnector interface documentation (#19172) · 65c69444
  Nick Hill authored Jun 06, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  65c69444
05 Jun, 2025 3 commits
- [P/D][NixlConnector] Enable FlashInfer backend (#19090) · 9ef9173c
  Nicolò Lucchesi authored Jun 05, 2025
  
  9ef9173c
- [MISC][Bugfix] Use less CPU when message queue has been empty for some time (#16226) · 85e2b7bb
  Povilas Kanapickas authored Jun 05, 2025
```
Signed-off-by: Povilas Kanapickas <povilas@radix.lt>
```
  85e2b7bb
- [Bugfix][Nixl] Fix full prefix cache hit bug (#18632) · c56ed8bb
  Robert Shaw authored Jun 04, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  c56ed8bb
04 Jun, 2025 3 commits
- [P/D] Heterogeneous TP (#18833) · b2fac671
  Nicolò Lucchesi authored Jun 05, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
```
  b2fac671
- [Bugfix][EP+DP] Fix internode check (#19112) · d459fae0
  Tyler Michael Smith authored Jun 04, 2025
```
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
```
  d459fae0
- feat: add data parallel rank to KVEventBatch (#18925) · b712be98
  Yan Ru Pei authored Jun 03, 2025
  
  b712be98
03 Jun, 2025 6 commits
- [Bugfix][P/D] Fix Prefix Cache Bug (#18411) · 5d96533e
  Nicolò Lucchesi authored Jun 04, 2025
```
Signed-off-by: nicklucche <nlucches@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  5d96533e
- [Kernel] DeepEP dispatch-combine kernel integration (#18434) · fa98d777
  Varun Sundar Rabindranath authored Jun 03, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fa98d777
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [CPU][CI] Re-enable the CPU CI tests (#19046) · 8655f47f
  Li, Jiang authored Jun 03, 2025
```
Signed-off-by: jiang.li <jiang1.li@intel.com>
```
  8655f47f
- [Bugfix][EP+DP] Use pplx-kernel internode instead of intranode (#19034) · 8a57872b
  Tyler Michael Smith authored Jun 02, 2025
```
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8a57872b
- [Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011) · 9112b443
  Siyuan Liu authored Jun 02, 2025
```
Signed-off-by: Siyuan Liu <lsiyuan@google.com>
Co-authored-by: Hossein Sarshar <hossein.sarshar@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@google.com>
```
  9112b443
02 Jun, 2025 1 commit
- [Bugfix][Nixl] Fix DP Metadata Handshake (#19008) · b9f61e13
  Robert Shaw authored Jun 01, 2025
```
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
```
  b9f61e13
01 Jun, 2025 1 commit
- [BugFix] fix data parallel construct ipv6 url addres (#18991) · aa54a7bf
  rongfu.leng authored Jun 01, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  aa54a7bf
31 May, 2025 1 commit
- [P/D] NixlConnector use cache device index for memory registration (#18969) · 8bf507d7
  ptarasiewiczNV authored May 31, 2025
```
Signed-off-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
```
  8bf507d7
29 May, 2025 1 commit
- [P/D] NixlConnector DP fixes (#18903) · 64eaf5fe
  Will Eaton authored May 29, 2025
```
Signed-off-by: Will Eaton <weaton@redhat.com>
```
  64eaf5fe
28 May, 2025 1 commit
- [Platform][Dist] Make torch distributed process group extendable (#18763) · d781930f
  Mengqing Cao authored May 28, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  d781930f
27 May, 2025 1 commit
- Minor fix about MooncakeStoreConnector (#18721) · c24b1572
  maobaolong authored May 27, 2025
```
Signed-off-by: baoloongmao <baoloongmao@tencent.com>
```
  c24b1572
24 May, 2025 1 commit
- [MISC] typo fix and clean import (#18664) · 4ceafb62
  Ning Xie authored May 24, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  4ceafb62
23 May, 2025 4 commits
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- [v1] Redo "Support multiple KV cache groups in GPU model runner (#17945)" (#18593) · 6550114c
  Chen Zhang authored May 24, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  6550114c
- Refactor pplx init logic to make it modular (prepare for deepep) (#18200) · 6a7988c5
  youkaichao authored May 23, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  6a7988c5
- [Feature]Add async tensor parallelism using compilation pass (#17882) · 71ea614d
  cascade authored May 23, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  71ea614d