Commits · 5e00b561cddd2cecf8be7a341cb49d446613d6ef · OpenDAS / vllm_cscc · GitLab

22 Jan, 2026 1 commit
- [Model Runner V2] Do not error on attention backends (#32820) · 5e00b561
  Woosuk Kwon authored Jan 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  5e00b561
21 Jan, 2026 10 commits
- [Model Runner V2] Refactor Prompt Logprobs (#32811) · 408195ec
  Woosuk Kwon authored Jan 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  408195ec
- [ModelRunner V2] Don't pin reused flashinfer tensors (#32799) · 24dc30f7
  Nick Hill authored Jan 21, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  24dc30f7
- [Model Runner V2] Minor refactor for `compute_slot_mappings` (#32794) · e1da249c
  Woosuk Kwon authored Jan 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e1da249c
- Bump Flashinfer to v0.6.1 (#30993) · 808d6fd7
  elvischenv authored Jan 22, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  808d6fd7
- [ROCm][Deepseekv3.2] Refactor Sparse Indexer as CustomOp (#29287) · 6c20e89c
  Pleaplusone authored Jan 21, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
```
  6c20e89c
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68
- Update FlashMLA (#32491) · b4f64e5b
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  b4f64e5b
- Added qwen3 vision language moe support for speculative decoding (#32048) · 7ab80a8e
  shanjiaz authored Jan 20, 2026
```
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
Signed-off-by: shanjiaz <43143795+shanjiaz@users.noreply.github.com>
```
  7ab80a8e
- [Cleanup] Remove unused `KVConnectorModelRunnerMixin` methods (#32077) · 6f067b1f
  Nick Hill authored Jan 20, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  6f067b1f
- OffloadingConnector: Prevent redundant loads (#29087) · 7013e9ac
  Or Ozeri authored Jan 21, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7013e9ac
20 Jan, 2026 10 commits
- [Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  22613408
- [Bugfix] Fix byte fallback handling when using outlines (#31391) · 86c69dc5
  Shinichi Hemmi authored Jan 21, 2026
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Co-authored-by: Kenichi Maehashi <maehashi@preferred.jp>
```
  86c69dc5
- [Model Runner V2] Support FLASHINFER_MLA backend (#32709) · 9ab4388c
  Woosuk Kwon authored Jan 20, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9ab4388c
- [Metrics] Complete removal of deprecated vllm:time_per_output_token_seconds metric (#32661) · bb917203
  杨朱 · Kiki authored Jan 20, 2026
```
This PR completes the removal of the deprecated vllm:time_per_output_token_seconds
metric that was deprecated in v0.11, hidden in v0.12, scheduled for removal in v0.13,
but delayed until v0.15.
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Haiku 4.5 <noreply@anthropic.com>
```
  bb917203
- [Core] Cleanup shm based object store on engine shutdown (#32429) · 8be263c3
  Walter Beller-Morales authored Jan 20, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  8be263c3
- [Model Runner V2] Skip kernel launch for penalties & logit_bias (#32634) · e9c83cdc
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e9c83cdc
- [Model] Use context managers for encoder- and LM-only mode (#32605) · 4753f3bf
  Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4753f3bf
- [Model Runner V2] Decouple temperature from penalties (#32629) · 6c01ffb8
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6c01ffb8
- [Model Runner V2] Refactor get_cudagraph_and_dp_padding (#32625) · 7b7cdce9
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7b7cdce9
- [Model Runner V2] Initialized communication buffer for DP (#32624) · 05dc4bfa
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  05dc4bfa
19 Jan, 2026 6 commits
- [Model Runner V2] Refactor `dummy_run` (#32533) · 43fada53
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  43fada53
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
- [Core] Whisper support `torch.compile` (#30385) · 74c583bc
  Nicolò Lucchesi authored Jan 19, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  74c583bc
- [Model Runner V2] Refactor `update_states` (#32562) · 9a1f16da
  Woosuk Kwon authored Jan 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9a1f16da
- [Model Runner V2] Support VLM (#32546) · bb1848cd
  Woosuk Kwon authored Jan 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bb1848cd
- [BUGFIX] Fix degenerate strides in TRTLLM query tensors for FlashInfer... · 6101a26d
  Vadim Gimpelson authored Jan 19, 2026
```
[BUGFIX]  Fix degenerate strides in TRTLLM query tensors for FlashInfer backend. Fixes issue #32353 (#32417)
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  6101a26d
18 Jan, 2026 5 commits
- [Refactor] Remove unused file `pallas_kv_cache_update.py` (#32433) · 16de822c
  Wentao Ye authored Jan 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  16de822c
- [Model] Support Step1 Model (#32511) · c826c72a
  Li Xie authored Jan 18, 2026
```
Signed-off-by: xieli <xieli@stepfun.com>
```
  c826c72a
- [Model Runner V2] Minor optimization for eagle input processing (#32535) · 963dc0b8
  Woosuk Kwon authored Jan 17, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  963dc0b8
- [Performance] Improve Triton prefill attention kernel's performance (#32403) · 8cc26acd
  Isotr0py authored Jan 18, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8cc26acd
- [Model Runner V2] Move mrope_positions buffer to MRopeState (#32532) · 4147910f
  Woosuk Kwon authored Jan 17, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4147910f
17 Jan, 2026 1 commit
- [Misc] Fix typo: seperator -> separator in flashmla_sparse.py (#32411) · 2b99f210
  Guofang.Tang authored Jan 17, 2026
```
Signed-off-by: Guofang Tang <tinggofun@gmail.com>
Co-authored-by: Guofang Tang <tinggofun@gmail.com>
```
  2b99f210
16 Jan, 2026 2 commits
- [TPU][Core] Enable Pipeline Parallelism on TPU backend (#28506) · 484e22bc
  Chenyaaang authored Jan 16, 2026
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  484e22bc
- [Bugfix] Refactor to support DP parallel in R3 (#32306) · 03da3b52
  Hongxin Xu authored Jan 16, 2026
```
Signed-off-by: xhx1022 <1737006628@qq.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>
```
  03da3b52
15 Jan, 2026 5 commits
- [Attention][AMD] Make flash-attn optional (#30361) · 04741337
  Matthias Gehre authored Jan 15, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  04741337
- [Feature] Support async scheduling + PP (#32359) · b34474bf
  Wentao Ye authored Jan 15, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b34474bf
- [Model Runner V2] Support FlashInfer backend & Fix CUDA Graph bug [1/2] (#32348) · 6218034d
  Woosuk Kwon authored Jan 15, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6218034d
- [ROCm][Bugfix] Disable hip sampler to fix deepseek's accuracy issue on ROCm (#32413) · 77c16df3
  Pleaplusone authored Jan 16, 2026
```
Signed-off-by: ganyi <ygan@amd.com>
```
  77c16df3
- [ROCm][Perf] Enable shuffle kv cache layout and assembly paged attention... · 130d6c95
  Pleaplusone authored Jan 15, 2026
```
[ROCm][Perf] Enable shuffle kv cache layout and assembly paged attention kernel for `AiterFlashAttentionBackend` (#29887)
Signed-off-by: ganyi <ygan@amd.com>
```
  130d6c95