Commits · dff0a2b39475096f5456721bfc8df3c7fea3cc57 · OpenDAS / vllm_cscc

05 Dec, 2025 2 commits
- [NIXL] Add remote_request_id to kv_transfer_params (#29665) · dff0a2b3
  Mark McLoughlin authored Dec 05, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  dff0a2b3
- [NIXL] Add compatibility checking to NIXL KV connector handshake (#29503) · 949a6a19
  Mark McLoughlin authored Dec 05, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  949a6a19
02 Dec, 2025 1 commit
- Remove default values from `InitVar`s so that they're not stored (#29859) · 951445a5
  Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  951445a5
21 Nov, 2025 1 commit
- Revert "[Redo] #26368 (#28771)" (#29121) · 30b9c677
  Jialin Ouyang authored Nov 20, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  30b9c677
15 Nov, 2025 3 commits

Cyrus Leung authored Nov 15, 2025


Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

98b4d389

Revert "[Core] Performance: Use list[np.ndarray] instead of list[list… (#28773) · ac86bff8
Nick Hill authored Nov 14, 2025

ac86bff8

[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output... · 186352b2

Jialin Ouyang authored Nov 14, 2025


[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output tokens for GC optimization (#26368)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

186352b2

13 Nov, 2025 1 commit
- [KV Connector] Test async mode in scheduler tests (#28550) · 6e25b1cd
  Mark McLoughlin authored Nov 13, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  6e25b1cd
05 Nov, 2025 1 commit

[Hybrid allocator + kv connector] revert connector test changes related to... · 86dca07d

Kuntai Du authored Nov 05, 2025


[Hybrid allocator + kv connector] revert connector test changes related to hybrid allocator (#28011)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>

86dca07d

04 Nov, 2025 1 commit
- [KV Connector] Make KVCacheConfig an explicit constructor argument (#27887) · 58279c60
  Mark McLoughlin authored Nov 04, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  58279c60
25 Oct, 2025 1 commit
- [Core][Hybrid allocator + kv connector 1/n] Enable hybrid allocator + KV cache connector (#25712) · b8535403
  Kuntai Du authored Oct 24, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  b8535403
19 Oct, 2025 1 commit
- [Chore] Separate out hashing utilities from vllm.utils (#27151) · 8a297115
  dongbo910220 authored Oct 19, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  8a297115
14 Oct, 2025 1 commit
- [NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556) · 7e6edb14
  Chendi.Xue authored Oct 14, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  7e6edb14
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 1 commit
- [bugfix][DCP] fix block_size of hash in DCP prefix caching (#26296) · 606b00e8
  Chen Zhang authored Oct 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  606b00e8
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
30 Sep, 2025 1 commit
- [V1] [P/D] Add Support for KV Load Failure Recovery (#19330) · 9a9f48df
  David Ben-David authored Oct 01, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  9a9f48df
19 Sep, 2025 1 commit
- [KV offload][4/N] Offloading KV connector (#22595) · c59a0eca
  Or Ozeri authored Sep 19, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  c59a0eca
09 Sep, 2025 1 commit
- [Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673) · 82dfb12e
  Zebing Lin authored Sep 09, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  82dfb12e
29 Aug, 2025 1 commit
- [Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779) · 69f46359
  Flora Feng authored Aug 29, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  69f46359
19 Aug, 2025 1 commit
- [Spec Decode] Make `propose_draft_token_ids` non-blocking for lower TTFT (#23041) · c9b38be8
  Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c9b38be8
15 Aug, 2025 1 commit
- [v1] Move block_hashes from KVCacheManager to Request.block_hashes (#19728) · c280066f
  Or Ozeri authored Aug 16, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  c280066f
13 Aug, 2025 1 commit
- [Core] Use individual MM items in P0/P1 cache and model runner (#22570) · 19b927e5
  Cyrus Leung authored Aug 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  19b927e5
11 Aug, 2025 1 commit
- [BugFix] Fix KVConnectorOutput TPU breakage (#22598) · 5898b135
  Nick Hill authored Aug 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5898b135
03 Aug, 2025 1 commit

[V1] [P/D] Refactor KV Connector Path (#21980) · aefeea0f

David Ben-David authored Aug 03, 2025


Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>

aefeea0f

28 Jul, 2025 1 commit

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

11 Jul, 2025 1 commit
- [Attention] MLA - Flashinfer Ragged Prefill (#20034) · 5b032352
  Alexander Matveev authored Jul 10, 2025
  
  5b032352
30 Jun, 2025 1 commit
- [Optimization] Use Shared `CachedRequestData` Instance Across All Requests (#20232) · 2863befc
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2863befc
19 Jun, 2025 1 commit

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

06 Jun, 2025 1 commit
- [v1] Hybrid Memory Allocator (#17996) · f8a1a2d1
  Chen Zhang authored Jun 06, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  f8a1a2d1
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
30 May, 2025 1 commit
- [Perf] API-server scaleout with many-to-many server-engine comms (#17546) · 2dbe8c07
  Nick Hill authored May 30, 2025
  
  2dbe8c07
14 May, 2025 1 commit
- [KVConnector] Keep KVTransferParams as a dict (#18033) · 59dd311c
  Nick Hill authored May 14, 2025
  
  59dd311c
12 May, 2025 1 commit

[P/D] NIXL Integration (#17751) · d1911020

Robert Shaw authored May 12, 2025


Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Brent Salisbury <bsalisbu@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Brent Salisbury <bsalisbu@redhat.com>

d1911020