Commits · 652ba93da36d793e7f3ff8a0ecdb5d6b00107e68 · OpenDAS / vllm_cscc

04 Dec, 2025 2 commits
- [P/D] Introduce Mooncake Transfer Engine as kv_connector (#24718) · 842aba50
  dtc authored Dec 04, 2025
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
Signed-off-by: dtc <dtcccc@linux.alibaba.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  842aba50
- [KVConnector] remove unused code (the model aware kv ops class) (#29709) · 8aaa81b3
  Kuntai Du authored Dec 04, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  8aaa81b3
28 Nov, 2025 1 commit
- [mypy] Enable type checking for more directories (#29674) · 9e6bcda3
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9e6bcda3
27 Nov, 2025 2 commits
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
- [bugfix] avoid NIXL_ERR_REMOTE_DISCONNECT in nixl_connector when Prefill dies (#28120) · cd007a53
  Mathis Felardos authored Nov 27, 2025
```
Signed-off-by: Mathis Felardos <mathis@mistral.ai>
```
  cd007a53
26 Nov, 2025 2 commits

[Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
430dd4d9

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795) · 56531b79

George D. Torres authored Nov 25, 2025


Signed-off-by: George D. Torres <gdavtor@gmail.com>
Signed-off-by: George D. Torres <41129492+geodavic@users.noreply.github.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

56531b79

24 Nov, 2025 1 commit
- [NIXL] Use config to enable telemetry + NIXL version bump (#29305) · 26a46558
  Nicolò Lucchesi authored Nov 24, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  26a46558
22 Nov, 2025 1 commit
- [chore][LMCache connector] Remove useless logs from lmcache connector (#29069) · 77e1c035
  Yihua Cheng authored Nov 21, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  77e1c035
21 Nov, 2025 1 commit
- [NIXL] Fix after virtual block_size for host_buffer with heter kv_layout (#29122) · 460d02a4
  Chendi.Xue authored Nov 21, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  460d02a4
20 Nov, 2025 2 commits
- [KVConnector][Core] Support cross-layer KV blocks (#27743) · 64746471
  Or Ozeri authored Nov 20, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  64746471
- [DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache... · 05c2dee7
  Kuntai Du authored Nov 20, 2025
```
[DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache Multiprocess connector (#29039)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  05c2dee7
18 Nov, 2025 2 commits
- [NIXL] fix cpu PD after physical <> logical block_size PR (#28904) · c3e29786
  Chendi.Xue authored Nov 18, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  c3e29786
- [Bugfix][NIXL] Fix `block_size_ratio` when logical !=physical blocks (#28925) · 184b12fd
  Nicolò Lucchesi authored Nov 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  184b12fd
15 Nov, 2025 1 commit

[NIXL] heterogeneous block_size support (#26759) · c9e66585

Chendi.Xue authored Nov 14, 2025


Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

c9e66585

14 Nov, 2025 1 commit
- [Bugfix][Nixl] Fix kernel physical<>logical block_size issue (#28677) · 96b23b8e
  Nicolò Lucchesi authored Nov 14, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  96b23b8e
12 Nov, 2025 3 commits
- [KV connector][WIP] KV cache proxy based on LMCache multi-process mode (#27902) · 94a9ebcf
  Yihua Cheng authored Nov 12, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  94a9ebcf
- add cpu option for p/d in nixl_connector (#28356) · c5f10cc1
  ZhengHongming888 authored Nov 12, 2025
```
Signed-off-by: Hongming Zheng <hongming.zheng@intel.com>
```
  c5f10cc1
- [KVConnector] Enable get_block_ids_with_load_errors() in LMCache connector (#27978) · d1431523
  ziruiliu authored Nov 12, 2025
```
Signed-off-by: Zirui Liu <ziliu@ddn.com>
Signed-off-by: ziruiliu <ziliu@ddn.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  d1431523
11 Nov, 2025 3 commits
- [NIXL] Generalize block-first backend layouts (FlashInfer-like) (#28282) · a7ef3eb0
  Nicolò Lucchesi authored Nov 11, 2025
  
  a7ef3eb0
- [Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  b30dfa03
- [BugFix] Avoid calling KV connector layer APIs when metadata is unset (#28253) · cc079763
  David Ben-David authored Nov 11, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  cc079763
09 Nov, 2025 1 commit
- [Core] Simplify async KV output aggregation (#28327) · 289eb6c5
  Nick Hill authored Nov 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  289eb6c5
07 Nov, 2025 2 commits
- [PerfFix] Avoid separate thread for MP executor shm spin (take 2) (#28319) · 67a2da89
  Nick Hill authored Nov 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  67a2da89
- Revert "[PerfFix] Avoid separate thread for MP executor shm spin (#28012)" (#28289) · 68a72a5c
  Nicolò Lucchesi authored Nov 07, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  68a72a5c
05 Nov, 2025 2 commits

[CI]: Add LMCacheConnector Unit Tests (#27852) · 40db1944

Samuel Shen authored Nov 05, 2025


Signed-off-by: Samuel Shen <slshen@uchciago.edu>
Co-authored-by: Samuel Shen <slshen@uchciago.edu>
Co-authored-by: Yihua Cheng <yihua98@uchicago.edu>

40db1944

[V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955) · 428bc7bf
wangxiyuan authored Nov 05, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
428bc7bf

04 Nov, 2025 2 commits
- [PerfFix] Avoid separate thread for MP executor shm spin (#28012) · c9f66da8
  Nick Hill authored Nov 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c9f66da8
- [KV Connector] Make KVCacheConfig an explicit constructor argument (#27887) · 58279c60
  Mark McLoughlin authored Nov 04, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  58279c60
01 Nov, 2025 2 commits
- [KV offload] Offloading connector async scheduling support (#27648) · 685c99ee
  Yue Zhang authored Nov 02, 2025
```
Signed-off-by: KevinCheung2259 <2651309292@qq.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  685c99ee
- [Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0cdbe7b7
31 Oct, 2025 1 commit

[Bugfix] Missing NIXL metadata for handshake initialization if instance spans multi-node (#26338) · d6517be3

GuanLuo authored Nov 01, 2025


Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Signed-off-by: Guan Luo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

d6517be3

30 Oct, 2025 2 commits

[Misc] Replace CUDA_VISIBLE_DEVICES in DP with torch.cuda.set_device for... · 60f76baa

Ilya Markov authored Oct 30, 2025


[Misc] Replace CUDA_VISIBLE_DEVICES in DP with torch.cuda.set_device for device selection on cuda-like devices (#27564)
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

60f76baa

[BugFix] Handle unscheduled requests properly when async scheduling (#27756) · 2ce5c5d3
Nick Hill authored Oct 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
2ce5c5d3

29 Oct, 2025 4 commits
- [BugFix] Fix handling of resumed reqs in `SharedStorageConnector` (#27719) · d4aa1443
  Nick Hill authored Oct 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  d4aa1443
- [KVConnector] Add metrics to Prometheus-Grafana dashboard (#26811) · accb8fab
  Nicolò Lucchesi authored Oct 29, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  accb8fab
- [Chore] Optimize P2PNCCLEngine `http_address` (#27488) · 5522fb27
  Wentao Ye authored Oct 29, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5522fb27
- [KV Connector] Update lmcache connector with latest compatibility (#27681) · a4a4f0f6
  Shaoting authored Oct 28, 2025
```
Signed-off-by: Samuel Shen <slshen@uchicago.edu>
Co-authored-by: Samuel Shen <slshen@uchicago.edu>
```
  a4a4f0f6
28 Oct, 2025 1 commit

[nit]: Fix import for the lmcache integration (#27600) · 05e034f0

Samuel Shen authored Oct 28, 2025


Signed-off-by: Samuel Shen <slshen@uchicago.edu>
Co-authored-by: Samuel Shen <slshen@uchicago.edu>

05e034f0

27 Oct, 2025 1 commit
- [Misc] Clean up utils (#27552) · 7c2bdb83
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c2bdb83