Commits · 398a596ed249c14b76806900894304a62d653603 · OpenDAS / vllm_cscc

08 Dec, 2025 1 commit
- [MP executor] fix get device count for multi node of mp executor feature (#30042) · 398a596e
  weiguihua2 authored Dec 09, 2025
```
Signed-off-by: weiguihua2 <weiguihua2@huawei.com>
```
  398a596e
07 Dec, 2025 1 commit
- [MISC]: change NIXL compatibility hash logging level to debug (#30182) · 8d3da4c7
  AuruTus authored Dec 07, 2025
  
  8d3da4c7
06 Dec, 2025 1 commit
- [bugfix] fix type[AttentionBackend] bug in kv_connector_base_v1 (#30051) · d6aeaddf
  kx authored Dec 06, 2025
```
Signed-off-by: 01267596 <xiongkai123@cmbchina.com>
Co-authored-by: 01267596 <xiongkai123@cmbchina.com>
```
  d6aeaddf
05 Dec, 2025 4 commits
- [KVConnector][Feature] Support KV connector cache reset via /reset_prefix_cache (#27170) · adb31506
  Tova Movshovitz authored Dec 05, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
Signed-off-by: Tova Movshovitz <tovam@pliops.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  adb31506
- [NIXL] Add remote_request_id to kv_transfer_params (#29665) · dff0a2b3
  Mark McLoughlin authored Dec 05, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  dff0a2b3
- [NIXL] Small cleanup of unused variables (#29618) · 78c44fd7
  Nicolò Lucchesi authored Dec 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  78c44fd7
- [NIXL] Add compatibility checking to NIXL KV connector handshake (#29503) · 949a6a19
  Mark McLoughlin authored Dec 05, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  949a6a19
04 Dec, 2025 5 commits

Mercykid-bash authored Dec 05, 2025

Signed-off-by: Che Ruan <cr623@ic.ac.uk>
Signed-off-by: mengxingkongzhouhan <117415539+mengxingkongzhouhan@users.noreply.github.com>
Signed-off-by: Mercykid-bash <ruanche0218@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Che Ruan <cr623@ic.ac.uk>
Co-authored-by: mengxingkongzhouhan <117415539+mengxingkongzhouhan@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

1119f6e4

[KVConnector] Remove v0-related kv connector components such as kv pipe and kv... · ece2825a

Kuntai Du authored Dec 05, 2025


[KVConnector] Remove v0-related kv connector components such as kv pipe and kv lookup buffer (#29705)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>

ece2825a

[P/D] Introduce Mooncake Transfer Engine as kv_connector (#24718) · 842aba50

dtc authored Dec 04, 2025


Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
Signed-off-by: dtc <dtcccc@linux.alibaba.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

842aba50

[KVConnector] remove unused code (the model aware kv ops class) (#29709) · 8aaa81b3
Kuntai Du authored Dec 04, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
8aaa81b3
enable multi-node in external launcher mode (#29833) · ad32e3e1
Xieyang Xu authored Dec 03, 2025

ad32e3e1

03 Dec, 2025 1 commit

[CI] Add Async Eplb nightly CI tests (#29385) · 7fe9c1a2

WeiQing Chen authored Dec 03, 2025


Signed-off-by: David Chen <530634352@qq.com>
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

7fe9c1a2

01 Dec, 2025 1 commit

[Bugfix] Missing cached item in the MultiModalReceiverCache (#28525) · fc6acc88

knlnguyen1802 authored Dec 02, 2025


Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Chenguang Zheng <645327136@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

fc6acc88

29 Nov, 2025 1 commit
- [Doc]: fixing typos in various files. (#29717) · 04a797cd
  Didier Durand authored Nov 29, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  04a797cd
28 Nov, 2025 2 commits
- [mypy] Enable type checking for more directories (#29674) · 9e6bcda3
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9e6bcda3
- [Misc] Remove `yapf` directives (#29675) · 0808eb81
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0808eb81
27 Nov, 2025 3 commits
- [Deprecation] Advance deprecation status (#29617) · a24ea541
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a24ea541
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
- [bugfix] avoid NIXL_ERR_REMOTE_DISCONNECT in nixl_connector when Prefill dies (#28120) · cd007a53
  Mathis Felardos authored Nov 27, 2025
```
Signed-off-by: Mathis Felardos <mathis@mistral.ai>
```
  cd007a53
26 Nov, 2025 5 commits
- [TPU] add tpu_inference (#27277) · ba1fcd84
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  ba1fcd84
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
- Revert "[Bugfix] Fix GPT-OSS AR+NORM fusion (#28841)" (#29483) · 70d5953f
  Huamin Li authored Nov 26, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  70d5953f
- [UX] Suppress gloo log spam (#29250) · 8d6a89df
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8d6a89df
- [Misc] Add backup hash algorithm for FIPS constrained environments (#28795) · 56531b79
  George D. Torres authored Nov 25, 2025
```
Signed-off-by: George D. Torres <gdavtor@gmail.com>
Signed-off-by: George D. Torres <41129492+geodavic@users.noreply.github.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  56531b79
25 Nov, 2025 1 commit
- [Bugfix] Fix GPT-OSS AR+NORM fusion (#28841) · 6330f947
  elvischenv authored Nov 25, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  6330f947
24 Nov, 2025 2 commits
- [NIXL] Use config to enable telemetry + NIXL version bump (#29305) · 26a46558
  Nicolò Lucchesi authored Nov 24, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  26a46558
- [EPLB] Optimize EPLB for Async Rearrange Experts (#22179) · 2601f18a
  WeiQing Chen authored Nov 24, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: SunChenxiang123 <1291824390@qq.com>
```
  2601f18a
22 Nov, 2025 1 commit
- [chore][LMCache connector] Remove useless logs from lmcache connector (#29069) · 77e1c035
  Yihua Cheng authored Nov 21, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  77e1c035
21 Nov, 2025 1 commit
- [NIXL] Fix after virtual block_size for host_buffer with heter kv_layout (#29122) · 460d02a4
  Chendi.Xue authored Nov 21, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  460d02a4
20 Nov, 2025 2 commits
- [KVConnector][Core] Support cross-layer KV blocks (#27743) · 64746471
  Or Ozeri authored Nov 20, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  64746471
- [DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache... · 05c2dee7
  Kuntai Du authored Nov 20, 2025
```
[DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache Multiprocess connector (#29039)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  05c2dee7
19 Nov, 2025 1 commit

[Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4

Qiu authored Nov 20, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>

2fd893b4

18 Nov, 2025 2 commits
- [NIXL] fix cpu PD after physical <> logical block_size PR (#28904) · c3e29786
  Chendi.Xue authored Nov 18, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  c3e29786
- [Bugfix][NIXL] Fix `block_size_ratio` when logical !=physical blocks (#28925) · 184b12fd
  Nicolò Lucchesi authored Nov 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  184b12fd
16 Nov, 2025 1 commit

[V1] Support MP Executor for multi node distributed inference (#23691) · b316ac65

Lucia Fang authored Nov 16, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

b316ac65

15 Nov, 2025 1 commit

[NIXL] heterogeneous block_size support (#26759) · c9e66585

Chendi.Xue authored Nov 14, 2025


Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

c9e66585

14 Nov, 2025 2 commits
- [Bugfix][Nixl] Fix kernel physical<>logical block_size issue (#28677) · 96b23b8e
  Nicolò Lucchesi authored Nov 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  96b23b8e
- [BugFix] Fix multi-modal async scheduling race condition (#28706) · bc3e4306
  Nick Hill authored Nov 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  bc3e4306
12 Nov, 2025 1 commit

[Core][AMD] Migrate fully transparent sleep mode to ROCm platform (#12695) · 4ca5cd57

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Nov 13, 2025


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kliuae <kuanfu.liu@embeddedllm.com>

4ca5cd57