Commits · b634e619bbcfed0abe4e01d0e2d97fb1fdfdbbd5 · OpenDAS / vllm_cscc

08 Jan, 2026 1 commit
- Decouple page_size_bytes calculation in AttentionSpec for TPU/RPA Compatibility. (#31635) · b634e619
  Lumosis authored Jan 08, 2026
```
Signed-off-by: Lihao Ran <imlihao.ran@gmail.com>
Signed-off-by: Lumosis <30372757+Lumosis@users.noreply.github.com>
```
  b634e619
07 Jan, 2026 1 commit
- [KVConnector]: Enable Cross-layers KV cache layout for MultiConnector (#30761) · b89443b8
  Kfir Toledo authored Jan 07, 2026
```
Signed-off-by: Kfir Toledo <kfir.toledo@ibm.com>
```
  b89443b8
30 Dec, 2025 2 commits

[CI][NIXL] Split DPEP tests (#31491) · ab1af6aa
Nicolò Lucchesi authored Dec 30, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
ab1af6aa

[Prefix Cache] Include lora_name in BlockStored event for deterministic... · 39512aba

Sage authored Dec 30, 2025


[Prefix Cache] Include lora_name in BlockStored event for deterministic KV-cache reconstruction (#27577)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Co-authored-by: Sage <80211083+sagiahrac@users.noreply.github.com>

39512aba

24 Dec, 2025 1 commit
- [Chore] Remove unused `noqa`s (#31263) · aa3868ec
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa3868ec
23 Dec, 2025 2 commits
- [Core] Add a random suffix to frontend-provided request IDs (#27987) · f7900686
  Mark McLoughlin authored Dec 23, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  f7900686
- [Misc] Introduce `encode_*_url` utility function (#31208) · bb62dda2
  Cyrus Leung authored Dec 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  bb62dda2
18 Dec, 2025 1 commit
- [NIXL] Support P tensor-parallel-size > D tensor-parallel-size (#27274) · bc3700e0
  Nicolò Lucchesi authored Dec 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  bc3700e0
17 Dec, 2025 1 commit
- [Attention] Update tests to remove deprecated env vars (#30563) · 7eb6cb6c
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  7eb6cb6c
14 Dec, 2025 1 commit

[NIXL][BUG FIX] Fix a bug for PD with host_buffer after merging 29665 (#30420) · ae2e503d

Chendi.Xue authored Dec 14, 2025


Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>

ae2e503d

11 Dec, 2025 1 commit
- [KVConnector] Add KV events to KV Connectors (#28309) · f4417f84
  Martin Hickey authored Dec 11, 2025
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  f4417f84
10 Dec, 2025 1 commit

[P/D] KV Load Failure Recovery/Abort Configuration (#26813) · a9e4106f

Will Eaton authored Dec 10, 2025


Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Will Eaton <me@wseaton.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>

a9e4106f

09 Dec, 2025 2 commits
- kv_transfer: Rename the shared storage connectors (#30201) · 4c6fd258
  Or Ozeri authored Dec 09, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  4c6fd258
- [Disagg] Support large batch size in proxy server and update NixlConnector doc for DP (#28782) · 60d17251
  Ming Yang authored Dec 08, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  60d17251
07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
06 Dec, 2025 2 commits

[CI/Build][AMD] Use ROCM_ATTN instead of FLASH_ATTN test for... · b12f4a98

rasmith authored Dec 05, 2025


[CI/Build][AMD] Use ROCM_ATTN instead of FLASH_ATTN test for test_register_kv_caches for ROCm and update test for TRITON_ATTN (#29985)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

b12f4a98

[CI]: Remove unnecessary imports from test_lmache_integration (#30157) · 7e31c3a3
Samuel Shen authored Dec 05, 2025
```
Signed-off-by: Samuel Shen <slshen@uchicago.edu>
Co-authored-by: Samuel Shen <slshen@uchicago.edu>
```
7e31c3a3

05 Dec, 2025 4 commits

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315) · 66e674cd

Matthew Bonanni authored Dec 05, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

66e674cd

[NIXL] Add remote_request_id to kv_transfer_params (#29665) · dff0a2b3
Mark McLoughlin authored Dec 05, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
dff0a2b3

[NIXL] Small cleanup of unused variables (#29618) · 78c44fd7

Nicolò Lucchesi authored Dec 05, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

78c44fd7

[NIXL] Add compatibility checking to NIXL KV connector handshake (#29503) · 949a6a19
Mark McLoughlin authored Dec 05, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
949a6a19

03 Dec, 2025 1 commit

[CI/Build][AMD] Skip test_shared_storage_connector_hashes in... · 5aa9b090

rasmith authored Dec 03, 2025


[CI/Build][AMD] Skip test_shared_storage_connector_hashes in test_shared_storage_connector.py due to hipErrorLaunchFailure when calling .cpu() (#29839)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

5aa9b090

02 Dec, 2025 1 commit
- Remove default values from `InitVar`s so that they're not stored (#29859) · 951445a5
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  951445a5
27 Nov, 2025 1 commit
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
23 Nov, 2025 1 commit

[CI/Build][AMD] Skip test_multi_shared_storage_connector_consistency in... · 71362ffa

rasmith authored Nov 22, 2025


[CI/Build][AMD] Skip test_multi_shared_storage_connector_consistency  in test_multi_connector.py due to hipErrorLaunchFailure  when calling .cpu() (#29253)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

71362ffa

22 Nov, 2025 1 commit
- [CI/Build] Skip tests that require libcudart in test_lmcache_integration.py (#29228) · a4fdf240
  rasmith authored Nov 22, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  a4fdf240
21 Nov, 2025 1 commit
- Revert "[Redo] #26368 (#28771)" (#29121) · 30b9c677
  Jialin Ouyang authored Nov 20, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  30b9c677
20 Nov, 2025 1 commit
- [KVConnector][Core] Support cross-layer KV blocks (#27743) · 64746471
  Or Ozeri authored Nov 20, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  64746471
18 Nov, 2025 2 commits
- [NIXL] fix cpu PD after physical <> logical block_size PR (#28904) · c3e29786
  Chendi.Xue authored Nov 18, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  c3e29786
- [CI][NIXL] Change default `block_size` for tests (#28927) · f226a3f0
  Nicolò Lucchesi authored Nov 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f226a3f0
15 Nov, 2025 4 commits

[Redo] #26368 (#28771) · 98b4d389

Cyrus Leung authored Nov 15, 2025


Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

98b4d389

[NIXL] heterogeneous block_size support (#26759) · c9e66585

Chendi.Xue authored Nov 14, 2025


Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

c9e66585

Revert "[Core] Performance: Use list[np.ndarray] instead of list[list… (#28773) · ac86bff8
Nick Hill authored Nov 14, 2025

ac86bff8

[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output... · 186352b2

Jialin Ouyang authored Nov 14, 2025


[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output tokens for GC optimization (#26368)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

186352b2

13 Nov, 2025 1 commit
- [KV Connector] Test async mode in scheduler tests (#28550) · 6e25b1cd
  Mark McLoughlin authored Nov 13, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  6e25b1cd
11 Nov, 2025 1 commit
- [NIXL] Generalize block-first backend layouts (FlashInfer-like) (#28282) · a7ef3eb0
  Nicolò Lucchesi authored Nov 11, 2025
  
  a7ef3eb0
09 Nov, 2025 1 commit
- [Core] Simplify async KV output aggregation (#28327) · 289eb6c5
  Nick Hill authored Nov 09, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  289eb6c5
07 Nov, 2025 2 commits
- [PerfFix] Avoid separate thread for MP executor shm spin (take 2) (#28319) · 67a2da89
  Nick Hill authored Nov 07, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  67a2da89
- Revert "[PerfFix] Avoid separate thread for MP executor shm spin (#28012)" (#28289) · 68a72a5c
  Nicolò Lucchesi authored Nov 07, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  68a72a5c