Commits · 6330f9477db214477004df6546f86e3f14f8eab9 · OpenDAS / vllm_cscc

24 Nov, 2025 1 commit
- [Hybrid Allocator] Better layer padding strategy for gpt-oss eagle (#29303) · 71df2a57
  Chen Zhang authored Nov 24, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  71df2a57
22 Nov, 2025 1 commit
- [Misc] Further clean up chunked prefill and prefix caching init (#29186) · 5a480258
  Cyrus Leung authored Nov 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a480258
21 Nov, 2025 2 commits
- [KV Connector] Fix async connector prefix cache metrics (#28585) · c6fa3895
  Mark McLoughlin authored Nov 21, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  c6fa3895
- Revert "[Redo] #26368 (#28771)" (#29121) · 30b9c677
  Jialin Ouyang authored Nov 20, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  30b9c677
15 Nov, 2025 3 commits

Cyrus Leung authored Nov 15, 2025


Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

98b4d389

Revert "[Core] Performance: Use list[np.ndarray] instead of list[list… (#28773) · ac86bff8
Nick Hill authored Nov 14, 2025

ac86bff8

[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output... · 186352b2

Jialin Ouyang authored Nov 14, 2025


[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output tokens for GC optimization (#26368)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

186352b2

14 Nov, 2025 3 commits
- [Bugfix] TypeError: 'NoneType' object is not callable (#27410) · 0de4f217
  Marcin Ostrowski authored Nov 14, 2025
```
Signed-off-by: Marcin Ostrowski <marcinx.ostrowski@intel.com>
```
  0de4f217
- [Chore] Rename `SchedulerConfig.chunked_prefill_enabled` (#28735) · e2741f6c
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e2741f6c
- [Config] Clean up SchedulerConfig initialization (#28665) · 511a6b61
  Cyrus Leung authored Nov 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  511a6b61
13 Nov, 2025 1 commit
- [KV Connector] Test async mode in scheduler tests (#28550) · 6e25b1cd
  Mark McLoughlin authored Nov 13, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  6e25b1cd
12 Nov, 2025 2 commits

[BugFix] Priority scheduling and spec tokens preemption (#28558) · 58ce8d12
Andy Lo authored Nov 12, 2025
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
58ce8d12

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56

Chenguang Zheng authored Nov 12, 2025


Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>

4ccffe56

05 Nov, 2025 1 commit

[Hybrid allocator + kv connector] revert connector test changes related to... · 86dca07d

Kuntai Du authored Nov 05, 2025


[Hybrid allocator + kv connector] revert connector test changes related to hybrid allocator (#28011)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>

86dca07d

04 Nov, 2025 1 commit
- [AsyncScheduling] Don't schedule past request max_tokens (#27922) · 938a8169
  Nick Hill authored Nov 04, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  938a8169
03 Nov, 2025 1 commit
- [BugFix][LoRA] use adapter_id instead of id field of lora_request (#27728) · 1bf43ae3
  Biswa Panda authored Nov 02, 2025
```
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
```
  1bf43ae3
01 Nov, 2025 1 commit
- [Core] Async scheduling + structured outputs compatibility (#26866) · 0cdbe7b7
  Nick Hill authored Oct 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0cdbe7b7
25 Oct, 2025 1 commit
- [Core][Hybrid allocator + kv connector 1/n] Enable hybrid allocator + KV cache connector (#25712) · b8535403
  Kuntai Du authored Oct 24, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
```
  b8535403
23 Oct, 2025 2 commits
- [Metrics] [KVConnector] Add connector prefix cache hit rate stats (#26245) · 88afa110
  Tova Movshovitz authored Oct 23, 2025
```
Signed-off-by: tovam <tovam@pliops.com>
```
  88afa110
- [CORE] Support Prefix Caching with Prompt Embeds (#27219) · ff93cc8c
  Andrew Sansom authored Oct 23, 2025
```
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
```
  ff93cc8c
22 Oct, 2025 1 commit
- [Prefix Cache] Use LoRA name for consistent KV-cache block hashing (#27211) · 1651003c
  Sage authored Oct 22, 2025
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  1651003c
19 Oct, 2025 1 commit
- [Chore] Separate out hashing utilities from vllm.utils (#27151) · 8a297115
  dongbo910220 authored Oct 19, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
  8a297115
18 Oct, 2025 1 commit

[Chore] Separate out `vllm.utils.mem_utils` (#27143) · 1d165d6d

iAmir97 authored Oct 18, 2025

Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

1d165d6d

16 Oct, 2025 1 commit

[CI] Replace large models with tiny alternatives in tests (#24057) · 43721bc6

Tahsin Tunan authored Oct 16, 2025


Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

43721bc6

14 Oct, 2025 1 commit
- [Core] Streamline some structured output related code (#26737) · 4aed506b
  Nick Hill authored Oct 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  4aed506b
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 3 commits
- Fix some typing issues found by `mypy==1.18.2` (#26596) · 7c12763b
  Harry Mellor authored Oct 10, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7c12763b
- [bugfix][DCP] fix block_size of hash in DCP prefix caching (#26296) · 606b00e8
  Chen Zhang authored Oct 10, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  606b00e8
- [Metrics] Log multi-modal cache stats and fix reset (#26285) · ad430a67
  Cyrus Leung authored Oct 10, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ad430a67
09 Oct, 2025 1 commit
- [Core][KVConnector] Propagate all tokens on resumed preemptions (#24926) · d17f0fbf
  Qier Li authored Oct 09, 2025
```
Signed-off-by: Qier Li <kevin44036@gmail.com>
Co-authored-by: Qier Li <qier@fb.com>
```
  d17f0fbf
08 Oct, 2025 1 commit
- [Bugfix] Respect min_tokens in scheduler stop check (#26317) · f08919b7
  Elaine Zhao authored Oct 08, 2025
```
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
```
  f08919b7
07 Oct, 2025 2 commits
- [V0 Deprecation] Remove `VLLM_USE_V1` from tests (#26341) · 1e4ecca1
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1e4ecca1
- Optimize KV cache distribution for asymmetric pipeline parallelism (#25164) · d100d78e
  Grant Holmes (Ren) authored Oct 07, 2025
```
Signed-off-by: gholmes829 <g.holmes429@gmail.com>
```
  d100d78e
05 Oct, 2025 2 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit
- [CI Failure] fix_test_auto_prefix_cache_support (#26053) · 7d6b0338
  Huamin Li authored Oct 04, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  7d6b0338
30 Sep, 2025 3 commits

[CI] Move applicable tests to CPU (#24080) · bc546f76

Reza Barazesh authored Sep 30, 2025


Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bc546f76

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>