Commits · 17edd8a807019c8d1e58634aecb1de7984e8d467 · OpenDAS / vllm_cscc

04 Oct, 2025 1 commit
- [CI Failure] fix_test_auto_prefix_cache_support (#26053) · 7d6b0338
  Huamin Li authored Oct 04, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  7d6b0338
30 Sep, 2025 3 commits

[CI] Move applicable tests to CPU (#24080) · bc546f76

Reza Barazesh authored Sep 30, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bc546f76

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

[Bugfix]: Clean up chunked prefill logging when using whisper (#25075) · e23cacda
Simon Danielsson authored Sep 30, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
```
e23cacda

27 Sep, 2025 1 commit
- [CI/Build] Reorganize root-level V1 tests (#25767) · cd87bfbf
  Cyrus Leung authored Sep 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cd87bfbf
23 Sep, 2025 1 commit
- [Core] Use KVCacheBlock as much as possible instead of dict[block_id, KVCacheBlock] (#24830) · 4f8c4b89
  Jialin Ouyang authored Sep 23, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  4f8c4b89
20 Sep, 2025 1 commit
- [Hybrid Allocator] Support full attention with different hidden size (#25101) · 9607d5eb
  Chen Zhang authored Sep 19, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  9607d5eb
19 Sep, 2025 1 commit
- [Core][Prefix Hash] Fix prefix hash metrics sliding window maintainance (#24990) · 2506ce51
  Jialin Ouyang authored Sep 19, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  2506ce51
18 Sep, 2025 1 commit

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

15 Sep, 2025 3 commits
- [Tests] fix initialization of kv hash in tests (#24273) · 45bfa49c
  Mickaël Seznec authored Sep 15, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
```
  45bfa49c
- [UT] enhance free kv cache block queue popleft_n (#24220) · bc0f6059
  Ning Xie authored Sep 15, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  bc0f6059
- [kv cache] update num_free_blocks in the end (#24228) · 3f331398
  Ning Xie authored Sep 15, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  3f331398
14 Sep, 2025 1 commit
- [Hybrid Allocator] Support Pipeline Parallel (#23974) · 8e5cdcda
  Chen Zhang authored Sep 14, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  8e5cdcda
12 Sep, 2025 1 commit
- [Multimodal] Remove legacy multimodal fields in favor of MultiModalFeatureSpec (#24548) · 0377802c
  Flora Feng authored Sep 12, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  0377802c
09 Sep, 2025 1 commit
- [Core] Use sha256 bytes instead of BlockHash to reduce GC overhead (#23673) · 82dfb12e
  Zebing Lin authored Sep 09, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  82dfb12e
02 Sep, 2025 1 commit
- [Doc]: fix typos in Python comments (#24077) · fad73be1
  Didier Durand authored Sep 02, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  fad73be1
30 Aug, 2025 1 commit
- [UT] fix unify_kv_cache_configs when kv cache config needs sort (#23843) · 5490d633
  Ning Xie authored Aug 30, 2025
  
  5490d633
29 Aug, 2025 1 commit
- [Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779) · 69f46359
  Flora Feng authored Aug 29, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  69f46359
28 Aug, 2025 1 commit
- [Bugfix] Fix for V1 priority scheduling crashes at preemption (#23713) · 5da4f5d8
  Hanchenli authored Aug 27, 2025
```
Signed-off-by: Hanchenli <lihanc2002@gmail.com>
```
  5da4f5d8
26 Aug, 2025 1 commit

[Bugfix] Fix scheduling when repeated images in one request (#23544) · b5d34af3

Roger Wang authored Aug 26, 2025


Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>

b5d34af3

25 Aug, 2025 1 commit

[Core][Multimodal] Track encode cache entries by mm_hash and enable embedding... · d765cf01

Chenguang Zheng authored Aug 25, 2025


[Core][Multimodal] Track encode cache entries by mm_hash and enable embedding sharing between requests (#22711)
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

d765cf01

19 Aug, 2025 1 commit
- [Spec Decode] Make `propose_draft_token_ids` non-blocking for lower TTFT (#23041) · c9b38be8
  Woosuk Kwon authored Aug 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c9b38be8
16 Aug, 2025 1 commit
- [Refactor] Allow optional MultiModalKwargsItem in IPC (#23022) · 4dff91c9
  Cyrus Leung authored Aug 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4dff91c9
15 Aug, 2025 1 commit
- [v1] Move block_hashes from KVCacheManager to Request.block_hashes (#19728) · c280066f
  Or Ozeri authored Aug 16, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  c280066f
13 Aug, 2025 1 commit
- [Core] Use individual MM items in P0/P1 cache and model runner (#22570) · 19b927e5
  Cyrus Leung authored Aug 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  19b927e5
05 Aug, 2025 2 commits
- Revert "[Bugfix] V1 Fix the cursor leakage issue during request scheduling." (#22223) · 71758176
  Woosuk Kwon authored Aug 04, 2025
  
  71758176
- [Bugfix] V1 Fix the cursor leakage issue during request scheduling. (#21173) · 2dffac46
  PiteXChen authored Aug 05, 2025
```
Signed-off-by: CLFutureX <775523362@qq.com>
```
  2dffac46
30 Jul, 2025 1 commit

[Misc] Improve code readability of KVCacheManager (#21673) · 8f4a1c9a

Ruixiang Tan authored Jul 30, 2025


Signed-off-by: tanruixiang <tanruixiang0104@gmail.com>
Signed-off-by: Ruixiang Tan <819464715@qq.com>
Signed-off-by: GitHub <noreply@github.com>

8f4a1c9a

29 Jul, 2025 1 commit
- [KVCache] Make KVCacheSpec hashable (#21791) · 755fa8b6
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  755fa8b6
28 Jul, 2025 1 commit

[Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f

Cyrus Leung authored Jul 28, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

86ae693f

24 Jul, 2025 1 commit
- [v1][Core] Clean up usages of `SpecializedManager` (#21407) · fc5f756d
  Zhou Fang authored Jul 24, 2025
```
Signed-off-by: Zhou Fang <fang.github@gmail.com>
```
  fc5f756d
23 Jul, 2025 1 commit
- [Core] Add basic unit test for maybe_evict_cached_block (#21400) · a1f3610f
  Jialin Ouyang authored Jul 23, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  a1f3610f
22 Jul, 2025 1 commit

[Core] Introduce popleft_n and append_n in FreeKVCacheBlockQueue to further... · ed250545

Jialin Ouyang authored Jul 22, 2025


[Core] Introduce popleft_n and append_n in FreeKVCacheBlockQueue to further optimize block_pool (#21222)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

ed250545

21 Jul, 2025 1 commit
- [Misc] unify variable for LLM instance (#20996) · d9784107
  Ning Xie authored Jul 21, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d9784107
19 Jul, 2025 1 commit

[Core] Support Local Chunked Attention for Hybrid KV Cache (#19351) · 9a9fda14

Lucia Fang authored Jul 19, 2025


Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lu Fang <fanglu@meta.com>

9a9fda14

18 Jul, 2025 1 commit
- [Core] Avoid KVCacheBlock.__eq__ invocations in FreeKVCacheBlockQueue (#21005) · 0f199f19
  JialinOuyang-Meta authored Jul 18, 2025
```
Signed-off-by: Jialin Ouyang <jialino@meta.com>
```
  0f199f19
15 Jul, 2025 1 commit
- Implement Async Scheduling (#19970) · d4d30940
  Woosuk Kwon authored Jul 14, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d4d30940
14 Jul, 2025 1 commit
- [Prefix Cache] Add reproducible prefix-cache block hashing using SHA-256 + CBOR (64bit) (#20511) · 66f6fbd3
  Maroon Ayoub authored Jul 14, 2025
```
Signed-off-by: Maroon Ayoub <maroon.ayoub@ibm.com>
```
  66f6fbd3
12 Jul, 2025 1 commit
- [Sched] Enhance the logic to remove stopped requests from queues (#20739) · f45a3328
  Woosuk Kwon authored Jul 12, 2025
  
  f45a3328
04 Jul, 2025 1 commit
- [Structured Outputs][V1] Skipping with models doesn't contain tokenizers (#20365) · 4a98edff
  Aaron Pham authored Jul 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  4a98edff