Commits · d6953beb91da4e9c99be4c0a1304a2d24189535c · OpenDAS / vllm_cscc

05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit
- [Bugfix] Fix `_reqs_to_process` leak on abort (#26012) · 2a6dc67e
  Nicolò Lucchesi authored Oct 04, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2a6dc67e
03 Oct, 2025 1 commit
- [NIXL][Misc] Expose metrics from NIXL for logging to CLI (#25388) · 48f30902
  Nicolò Lucchesi authored Oct 03, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  48f30902
30 Sep, 2025 3 commits

[V1] [P/D] Add Support for KV Load Failure Recovery (#19330) · 9a9f48df
David Ben-David authored Oct 01, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
9a9f48df

[CI] Move applicable tests to CPU (#24080) · bc546f76

Reza Barazesh authored Sep 30, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bc546f76

[NIXL] Add support for MLA caches with different latent dim (#25902) · 80608ba5

Nicolò Lucchesi authored Sep 30, 2025


Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

80608ba5

29 Sep, 2025 1 commit
- [Nixl][P/D] Add cuda2cpu support (HD->DH transfer) (#24690) · d0d138bc
  Chenxi Yang authored Sep 29, 2025
```
Signed-off-by: Chenxi Yang <cxyang@fb.com>
Co-authored-by: Chenxi Yang <cxyang@fb.com>
```
  d0d138bc
26 Sep, 2025 1 commit
- [CI] Fix test_shared_storage_connector_hashes (#25748) · 2827b3f4
  Chauncey authored Sep 26, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  2827b3f4
23 Sep, 2025 4 commits
- [Docs] NixlConnector quickstart guide (#24249) · da5e7e43
  Peter Pan authored Sep 23, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Signed-off-by: Nicolò Lucchesi<nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
```
  da5e7e43
- [P/D] Support NIXL connector to disconnect during a clean shutdown (#24423) · f05a4f0e
  Chauncey authored Sep 23, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  f05a4f0e
- [NIXL][OOT platform] support nixl_connector with oot platform and other nixl_backend (#25121) · 5774b0a1
  Chendi.Xue authored Sep 22, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
  5774b0a1
- [Bugfix] Fix missing `clear_connector_metadata` (#25397) · 09019703
  Nicolò Lucchesi authored Sep 23, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  09019703
19 Sep, 2025 2 commits
- [KV offload][4/N] Offloading KV connector (#22595) · c59a0eca
  Or Ozeri authored Sep 19, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  c59a0eca
- [P/D][Nixl] Introduce `KVTransferMetrics` and aggregation strategy (#22188) · a3d087ad
  Nicolò Lucchesi authored Sep 19, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  a3d087ad
09 Sep, 2025 1 commit
- [Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673) · 82dfb12e
  Zebing Lin authored Sep 09, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  82dfb12e
03 Sep, 2025 2 commits
- [Doc]: fix typos in Python comments (#24093) · d7e1e599
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  d7e1e599
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
29 Aug, 2025 1 commit
- [Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779) · 69f46359
  Flora Feng authored Aug 29, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  69f46359
22 Aug, 2025 1 commit
- [P/D][Nixl] Make kv cache register compatible with hybrid memory allocator (#23079) · 53415653
  Flora Feng authored Aug 21, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  53415653
19 Aug, 2025 1 commit
- [Spec Decode] Make `propose_draft_token_ids` non-blocking for lower TTFT (#23041) · c9b38be8
  Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c9b38be8
15 Aug, 2025 1 commit
- [v1] Move block_hashes from KVCacheManager to Request.block_hashes (#19728) · c280066f
  Or Ozeri authored Aug 16, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  c280066f
13 Aug, 2025 2 commits
- [Core] Use individual MM items in P0/P1 cache and model runner (#22570) · 19b927e5
  Cyrus Leung authored Aug 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  19b927e5
- [Nixl][CI] Fix tests (#22806) · 6b794c75
  Nicolò Lucchesi authored Aug 13, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  6b794c75
12 Aug, 2025 2 commits
- [CI][Nixl] Check kv cache layout during handshake (#22745) · 422f22e0
  Nicolò Lucchesi authored Aug 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  422f22e0
- [Bugfix][CI] Fix `test_remote_decode_lifecycle.py::test_short_prompt_lifecycle` (#22727) · 3d9d40ef
  Nicolò Lucchesi authored Aug 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  3d9d40ef
11 Aug, 2025 2 commits
- fix: NIXL connector transfers partial block to pass full multi-modal context (#21074) · 16fb668b
  GuanLuo authored Aug 11, 2025
```
Signed-off-by: GuanLuo <gluo@nvidia.com>
```
  16fb668b
- [BugFix] Fix KVConnectorOutput TPU breakage (#22598) · 5898b135
  Nick Hill authored Aug 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5898b135
04 Aug, 2025 2 commits
- [CI Bugfix] Fix wNa16 kernel not found for test_shared_storage_connector_hashes (#22163) · 8ecb3e9e
  Tyler Michael Smith authored Aug 04, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8ecb3e9e
- [PD] add test for chat completions endpoint (#21925) · 0d7db16a
  Abirdcfly authored Aug 04, 2025
```
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
```
  0d7db16a
03 Aug, 2025 1 commit

[V1] [P/D] Refactor KV Connector Path (#21980) · aefeea0f

David Ben-David authored Aug 03, 2025


Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>

aefeea0f

02 Aug, 2025 1 commit
- docs: remove deprecated disable-log-requests flag (#22113) · 067c34a1
  Roger Wang authored Aug 02, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  067c34a1
31 Jul, 2025 1 commit
- [CI Bugfix] Fix CI OOM for `test_shared_storage_connector_hashes` (#21973) · 055bd397
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  055bd397
30 Jul, 2025 1 commit

[Bugfix] SharedStorage Connector for V1 PD multimodal (#21611) · 4904e53c

Chenguang Zheng authored Jul 31, 2025


Signed-off-by: fake0fan <645327136@qq.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>

4904e53c

28 Jul, 2025 3 commits

Revert "[V1] Exception Handling when Loading KV Cache from Remote Store" (#21778) · b18b417f
Kuntai Du authored Jul 28, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
b18b417f
[V1] Exception Handling when Loading KV Cache from Remote Store (#21534) · 15a72ac4
Adeline authored Jul 28, 2025
```
Signed-off-by: liuyumoye <adeline_ly2023@outlook.com>
Co-authored-by: liuyumoye <adeline_ly2023@outlook.com>
```
15a72ac4

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

24 Jul, 2025 2 commits

[P/D] Support CPU Transfer in NixlConnector (#18293) · 60662849

Juncheng Gu authored Jul 24, 2025


Signed-off-by: Juncheng Gu <juncgu@gmail.com>
Signed-off-by: Richard Liu <ricliu@google.com>
Co-authored-by: Richard Liu <39319471+richardsliu@users.noreply.github.com>
Co-authored-by: Richard Liu <ricliu@google.com>

60662849

[P/D] Move FakeNixlWrapper to test dir (#21328) · 1e9ea8e6
Rui Qiao authored Jul 24, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
1e9ea8e6

20 Jul, 2025 1 commit
- [bugfix] fix syntax warning caused by backslash (#21251) · 7ba34b12
  Jiayi Yan authored Jul 21, 2025
  
  7ba34b12
19 Jul, 2025 1 commit
- [BugFix] Make PD work with Ray (#21072) · 9f414a12
  kourosh hakhamaneshi authored Jul 19, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  9f414a12