Commits · a810671a261997b5d95fee7868d79514844e6e81 · OpenDAS / vllm_cscc

18 Dec, 2025 5 commits
- [NIXL][BUG FIX] Fix both failing issue and accuracy issue with nixl + host_buffer on CUDA (#30419) · 6ca74bc1
  Chendi.Xue authored Dec 18, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  6ca74bc1
- [BugFix]Reclaim resources to prevent memory leaks when use LMCacheMPConnector (#30745) · 889f8bb2
  wz1qqx authored Dec 19, 2025
```
Signed-off-by: wz1qqx <ziqi.wang@novita.ai>
Co-authored-by: wz1qqx <ziqi.wang@novita.ai>
```
  889f8bb2
- [Platform] Let EPD work with non-cuda platform (#30225) · a85724bd
  wangxiyuan authored Dec 18, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  a85724bd
- [KV connector][LMCache] Only record the cuda event when there are request to store/load (#30814) · ec965569
  Yihua Cheng authored Dec 17, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  ec965569
- [NIXL] Support P tensor-parallel-size > D tensor-parallel-size (#27274) · bc3700e0
  Nicolò Lucchesi authored Dec 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  bc3700e0
17 Dec, 2025 1 commit

[Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475) · 16484d39

Roger Wang authored Dec 16, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Sun Kim <sunytokki@gmail.com>
(cherry picked from commit f5f51e59)

16484d39

16 Dec, 2025 2 commits
- [Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475) · f5f51e59
  Roger Wang authored Dec 16, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Sun Kim <sunytokki@gmail.com>
```
  f5f51e59
- [Perf] Do FP4 quant before All gather on flashinfer trtllmgen MOE (#30014) · 254a7f8f
  jiahanc authored Dec 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  254a7f8f
14 Dec, 2025 3 commits

[NIXL][BUG FIX] Fix a bug for PD with host_buffer after merging 29665 (#30420) · ae2e503d

Chendi.Xue authored Dec 14, 2025


Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>

ae2e503d

[ROCm][CI] Add "Qwen3-Next-80B-A3B-Instruct MTP Async EPLB Accuracy Test" Back Into AMD CI (#30590) · 97f2f160

Micah Williamson authored Dec 14, 2025

Signed-off-by: David Chen <530634352@qq.com>
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

97f2f160

[Bug][KVConnector][Metrics] Remove a vacuous assertion breaking external-launcher (#30577) · dc7fb5be
Qier Li authored Dec 13, 2025
```
Co-authored-by: Qier Li <qier@fb.com>
```
dc7fb5be

12 Dec, 2025 1 commit
- [LMCache] Relax lmcache version requirement (#30425) · 947dfda9
  Nick Hill authored Dec 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  947dfda9
11 Dec, 2025 2 commits
- [KVConnector] Add KV events to KV Connectors (#28309) · f4417f84
  Martin Hickey authored Dec 11, 2025
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  f4417f84
- Revert "[CI] Add Async Eplb nightly CI tests (#29385)" (#30431) · b4054c8a
  Sage Moore authored Dec 10, 2025
  
  b4054c8a
10 Dec, 2025 3 commits
- fix(shm): Add memory barriers for cross-process shared memory visibility (#30407) · 166ac3c9
  Christina Norman authored Dec 10, 2025
```
Signed-off-by: Christina Holland <hey@christinaholland.com>
Signed-off-by: Christina <truffle@gmail.com>
```
  166ac3c9
- [LMCache] Fix breakage due to new LMCache version (#30216) · 6ccb7bae
  Nick Hill authored Dec 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  6ccb7bae
- [Perf] Enable environment cache in EngineCore to enable the feature for... · 9f042ba2
  Jialin Ouyang authored Dec 10, 2025
```
[Perf] Enable environment cache in EngineCore to enable the feature for UniProcExecutor as well (#29289)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  9f042ba2
09 Dec, 2025 1 commit
- kv_transfer: Rename the shared storage connectors (#30201) · 4c6fd258
  Or Ozeri authored Dec 09, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  4c6fd258
08 Dec, 2025 2 commits
- [Perf] Improve fp8 quant in mla; replace ReduceSum with ReduceScatterSum (#29795) · 1fb632fd
  Lain authored Dec 08, 2025
```
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
```
  1fb632fd
- [MP executor] fix get device count for multi node of mp executor feature (#30042) · 398a596e
  weiguihua2 authored Dec 09, 2025
```
Signed-off-by: weiguihua2 <weiguihua2@huawei.com>
```
  398a596e
07 Dec, 2025 1 commit
- [MISC]: change NIXL compatibility hash logging level to debug (#30182) · 8d3da4c7
  AuruTus authored Dec 07, 2025
  
  8d3da4c7
06 Dec, 2025 1 commit
- [bugfix] fix type[AttentionBackend] bug in kv_connector_base_v1 (#30051) · d6aeaddf
  kx authored Dec 06, 2025
```
Signed-off-by: 01267596 <xiongkai123@cmbchina.com>
Co-authored-by: 01267596 <xiongkai123@cmbchina.com>
```
  d6aeaddf
05 Dec, 2025 4 commits
- [KVConnector][Feature] Support KV connector cache reset via /reset_prefix_cache (#27170) · adb31506
  Tova Movshovitz authored Dec 05, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
Signed-off-by: Tova Movshovitz <tovam@pliops.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  adb31506
- [NIXL] Add remote_request_id to kv_transfer_params (#29665) · dff0a2b3
  Mark McLoughlin authored Dec 05, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  dff0a2b3
- [NIXL] Small cleanup of unused variables (#29618) · 78c44fd7
  Nicolò Lucchesi authored Dec 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  78c44fd7
- [NIXL] Add compatibility checking to NIXL KV connector handshake (#29503) · 949a6a19
  Mark McLoughlin authored Dec 05, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  949a6a19
04 Dec, 2025 5 commits

Abstract eplb algo (#26471) · 1119f6e4

Mercykid-bash authored Dec 05, 2025

Signed-off-by: Che Ruan <cr623@ic.ac.uk>
Signed-off-by: mengxingkongzhouhan <117415539+mengxingkongzhouhan@users.noreply.github.com>
Signed-off-by: Mercykid-bash <ruanche0218@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Che Ruan <cr623@ic.ac.uk>
Co-authored-by: mengxingkongzhouhan <117415539+mengxingkongzhouhan@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

1119f6e4

[KVConnector] Remove v0-related kv connector components such as kv pipe and kv... · ece2825a

Kuntai Du authored Dec 05, 2025


[KVConnector] Remove v0-related kv connector components such as kv pipe and kv lookup buffer (#29705)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>

ece2825a

[P/D] Introduce Mooncake Transfer Engine as kv_connector (#24718) · 842aba50

dtc authored Dec 04, 2025


Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
Signed-off-by: dtc <dtcccc@linux.alibaba.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

842aba50

[KVConnector] remove unused code (the model aware kv ops class) (#29709) · 8aaa81b3
Kuntai Du authored Dec 04, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
8aaa81b3
enable multi-node in external launcher mode (#29833) · ad32e3e1
Xieyang Xu authored Dec 03, 2025

ad32e3e1

03 Dec, 2025 1 commit

[CI] Add Async Eplb nightly CI tests (#29385) · 7fe9c1a2

WeiQing Chen authored Dec 03, 2025


Signed-off-by: David Chen <530634352@qq.com>
Signed-off-by: WeiQing Chen <40507679+david6666666@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

7fe9c1a2

01 Dec, 2025 1 commit

[Bugfix] Missing cached item in the MultiModalReceiverCache (#28525) · fc6acc88

knlnguyen1802 authored Dec 02, 2025


Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Chenguang Zheng <645327136@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

fc6acc88

29 Nov, 2025 1 commit
- [Doc]: fixing typos in various files. (#29717) · 04a797cd
  Didier Durand authored Nov 29, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  04a797cd
28 Nov, 2025 2 commits
- [mypy] Enable type checking for more directories (#29674) · 9e6bcda3
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9e6bcda3
- [Misc] Remove `yapf` directives (#29675) · 0808eb81
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0808eb81
27 Nov, 2025 3 commits
- [Deprecation] Advance deprecation status (#29617) · a24ea541
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a24ea541
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
- [bugfix] avoid NIXL_ERR_REMOTE_DISCONNECT in nixl_connector when Prefill dies (#28120) · cd007a53
  Mathis Felardos authored Nov 27, 2025
```
Signed-off-by: Mathis Felardos <mathis@mistral.ai>
```
  cd007a53
26 Nov, 2025 1 commit
- [TPU] add tpu_inference (#27277) · ba1fcd84
  Johnny Yang authored Nov 26, 2025
```
Signed-off-by: Johnny Yang <johnnyyang@google.com>
```
  ba1fcd84