Commits · e535d90debb39e8462cd39004fb7e0d9ded10740 · OpenDAS / vllm_cscc

01 Feb, 2026 6 commits
- [ModelRunner V2] Misc minor simplifications and optimizations (#33467) · e535d90d
  Nick Hill authored Feb 01, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  e535d90d
- [Misc] skip target model mm emb in draft proposal step when draft is text-only (#33437) · 0b225fb7
  Komal Kumar Teru authored Feb 02, 2026
```
Signed-off-by: kkt-cohere <komal@cohere.com>
```
  0b225fb7
- [Redo] #33110 with threading limit (#33502) · 21997f45
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: YunzhuLu <lucia.yunzhu@gmail.com>
```
  21997f45
- [Critical] Revert #33110 (#33500) · b6bb2842
  Cyrus Leung authored Feb 01, 2026
  
  b6bb2842
- [Bugfix] Fix inconsistent handling of cache reset (#33481) · 79b6ec6a
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  79b6ec6a
- [Refactor] Make Renderer an abstract class (#33479) · a358e4df
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a358e4df
31 Jan, 2026 15 commits
- Fix grammar (#33121) · 1e86c802
  smashyalts authored Jan 31, 2026
```
Signed-off-by: smashyalts <smashyalts@gmail.com>
```
  1e86c802
- [Refactor] Move MM data parsing outside processor (#33408) · 88c3e114
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  88c3e114
- [Bugfix] Early-reject requests with MM data longer than encode cache capacity (#33110) · 27cb2f67
  YunzhuLu authored Feb 01, 2026
```
Signed-off-by: YunzhuLu <lucia.yunzhu@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  27cb2f67
- Support clear mm and encoder cache (#33452) · 22d9a056
  jma99_2333 authored Jan 31, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  22d9a056
- [BugFix][Router Replay] Capture Logical Experts with EPLB (#33013) · 13b842f2
  ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Jan 31, 2026
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
  13b842f2
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
- [perf] v1/spec_decode: skip softmax for all-greedy rejection sampling (#32852) · 8980001c
  caozuoba authored Jan 31, 2026
```
Signed-off-by: hdj <1293066020@qq.com>
```
  8980001c
- [ROCM] Enable aiter attn backend for qwen3-next model (#32492) · 527bcd14
  jennyyyyzhen authored Jan 31, 2026
```
Signed-off-by: jennyyyyzhen <yzhen@hmc.edu>
```
  527bcd14
- [Attention] Clarify comment explaining attn_logits +1 dimension (#33427) · 5b55c0be
  Francesco Fusco authored Jan 31, 2026
```
Signed-off-by: Francesco Fusco <ffu@zurich.ibm.com>
```
  5b55c0be
- [Misc] offest -> offset in comments and variable names (#33444) · a2ef06e1
  Russell Bryant authored Jan 30, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  a2ef06e1
- [BugFix] Fix whisper FA2 + full cudagraphs (#33360) · 0a3c71e7
  Lucas Wilkinson authored Jan 30, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  0a3c71e7
- [ModelRunner V2] Fix spec decoding + logprobs (#33391) · 876a16f4
  Nick Hill authored Jan 30, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  876a16f4
- [Attention] Move MLA `forward` from backend to layer (#33284) · aaa901ad
  Matthew Bonanni authored Jan 30, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  aaa901ad
- [Deprecation] Deprecate `seed_everything` and `scatter_mm_placeholders` in v0.15 (#33362) · 010ec0c3
  Wentao Ye authored Jan 30, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  010ec0c3
- [Bugfix] Fix typo in read_offset variable name (#33426) · 64a40a7a
  Alberto Ferrer authored Jan 30, 2026
```
Signed-off-by: Alberto Ferrer <albertof@barrahome.org>
```
  64a40a7a
30 Jan, 2026 5 commits
- [QeRL] Layerwise Reloading (#32133) · f857a03f
  Kyle Sayers authored Jan 30, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  f857a03f
- [Realtime API] Adds minimal realtime API based on websockets (#33187) · 10152d21
  Patrick von Platen authored Jan 30, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  10152d21
- [Misc] Replace Optional[X] with X | None syntax (#33332) · 1a7894db
  杨朱 · Kiki authored Jan 30, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  1a7894db
- [Refactor] Move MM item count validation outside of processor (#33396) · c87eac18
  Cyrus Leung authored Jan 30, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c87eac18
- [CI] Enable mypy import following for `vllm/spec_decode` (#33282) · 726d8972
  Lucas Kabela authored Jan 29, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  726d8972
29 Jan, 2026 5 commits
- [BUGFIX][XPU] fix memory check after XPU reuse GPU_worker (#33358) · 8c8ebeb9
  Chendi.Xue authored Jan 29, 2026
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  8c8ebeb9
- [Multimodal] Simplify MM input definitions (#33331) · c6e7404c
  Cyrus Leung authored Jan 29, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c6e7404c
- [Intel GPU] refine xpu worker (#32894) · 8bb6271c
  Kunshang Ji authored Jan 29, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  8bb6271c
- Make `mypy` opt-out instead of opt-in (#33205) · fb946a7f
  Harry Mellor authored Jan 29, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb946a7f
- [Doc]: fixing multiple typos in diverse files (#33256) · 31b25f65
  Didier Durand authored Jan 29, 2026
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  31b25f65
28 Jan, 2026 7 commits

[ModelRunner V2] Misc code simplification and cleanup (#33266) · 6bf3b46d
Nick Hill authored Jan 28, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
6bf3b46d
[Bugfix] Add missing encoder only guard for do_kv_cache_update (#33269) · ab597c86
Gregory Shtrasberg authored Jan 28, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
ab597c86

[Feature] Fully support for async scheduling + PP, 30.8% E2E throughput... · 3e440786

Wentao Ye authored Jan 28, 2026


[Feature] Fully support for async scheduling + PP, 30.8% E2E throughput improvement, 31.8% TPOT improvement (#32618)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

3e440786

[ROCm] Enabling forward_includes_kv_cache on ROCm MHA backends (#33106) · 22ad6495
Gregory Shtrasberg authored Jan 28, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
22ad6495
[Bugfix] Lazy import NgramProposer in GPU model runner (#32821) · a2b877df
22quinn authored Jan 27, 2026
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
a2b877df
Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2eb673a0

[Model Runner V2] Use a different stream for grammar bitmask h2d copy (#33059) · 46ec6d71

Woosuk Kwon authored Jan 27, 2026


Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Nick Hill <nhill@redhat.com>

46ec6d71

27 Jan, 2026 2 commits
- [Perf] Optimize dcp allocate tensor (#33102) · 3a6d5cbe
  Wentao Ye authored Jan 27, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3a6d5cbe
- feature: support eagle3 for HunyuanVL & Hunyuan (#33035) · bd92089d
  Iris authored Jan 28, 2026
```
Signed-off-by: irisliu10 <601012173@qq.com>
Signed-off-by: Iris <38269816+irisliu10@users.noreply.github.com>
```
  bd92089d