Commits · b4f64e5b02a949c8856c9f81990b77ca56296cdc · OpenDAS / vllm_cscc

21 Jan, 2026 7 commits
- Update FlashMLA (#32491) · b4f64e5b
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  b4f64e5b
- Added qwen3 vision language moe support for speculative decoding (#32048) · 7ab80a8e
  shanjiaz authored Jan 20, 2026
```
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
Signed-off-by: shanjiaz <43143795+shanjiaz@users.noreply.github.com>
```
  7ab80a8e
- Enable Eagle3 speculative decoding for Pixtral (LlavaForConditionalGeneration) (#32542) · 0900cedb
  gopalsarda authored Jan 20, 2026
```
Signed-off-by: gopalsarda <gopal.sarda@servicenow.com>
```
  0900cedb
- [Cleanup] Remove unused `KVConnectorModelRunnerMixin` methods (#32077) · 6f067b1f
  Nick Hill authored Jan 20, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  6f067b1f
- [Bugfix] Fix Granite Vision / Don't use Siglip Pooling Head Nested Models by Default (#32299) · 27b81e01
  Alex Brooks authored Jan 20, 2026
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  27b81e01
- OffloadingConnector: Prevent redundant loads (#29087) · 7013e9ac
  Or Ozeri authored Jan 21, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7013e9ac
- Revert "[PluggableLayer][1/N] Define PluggableLayer" (#32725) · c78ee240
  Robert Shaw authored Jan 20, 2026
  
  c78ee240
20 Jan, 2026 30 commits
- fp8 online quant: split out Fp8OnlineLinearMethod (#32189) · d2389c12
  Vasiliy Kuznetsov authored Jan 20, 2026
  
  d2389c12
- [ROCm][CI] Remove DS async eplb accuracy test from AMD CI (#32717) · 22375f8d
  Micah Williamson authored Jan 20, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  22375f8d
- [Bugfix] Suppress log on non-ROCm platform (#32703) · 9b67338b
  TJian authored Jan 21, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  9b67338b
- [Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  22613408
- [Bugfix] Fix byte fallback handling when using outlines (#31391) · 86c69dc5
  Shinichi Hemmi authored Jan 21, 2026
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Co-authored-by: Kenichi Maehashi <maehashi@preferred.jp>
```
  86c69dc5
- [AOT compilation] support torch.compile inductor artifacts in VllmCompiledFunction (#25205) · 7c5dedc2
  dolpm authored Jan 20, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  7c5dedc2
- [5/N] Initialize MM components in context managers (Q-Z) (#32695) · 193069d1
  Cyrus Leung authored Jan 21, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  193069d1
- Test: added acceptance length tests (#32030) · f0feb1cf
  Rahul Tuli authored Jan 21, 2026
```
Signed-off-by: rahul-tuli <rtuli@redhat.com>
```
  f0feb1cf
- [Doc] Update docs for MM model development with context usage (#32691) · 09194b90
  Cyrus Leung authored Jan 21, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09194b90
- [Model Runner V2] Support FLASHINFER_MLA backend (#32709) · 9ab4388c
  Woosuk Kwon authored Jan 20, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9ab4388c
- [Bugfix] fix the ima issue of qwen-vit (#32687) · 04a9e064
  JJJYmmm authored Jan 21, 2026
```
Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
```
  04a9e064
- [Doc] [ROCm] Update ROCm getting started doc (#32580) · c025263d
  TJian authored Jan 21, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Hongxia Yang <hongxia.yang@amd.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c025263d
- [Perf] Only clone when needed for `moe_permute` (#32273) · 6c97b9b9
  Wentao Ye authored Jan 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6c97b9b9
- [PluggableLayer][1/N] Define PluggableLayer (#32331) · 4ca62a0d
  whx authored Jan 21, 2026
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  4ca62a0d
- [Bugfix] Fix Off-by-one error in _num_tokens_to_min_blocks calculation (#32603) · 7901109e
  linhaifeng authored Jan 21, 2026
```
Signed-off-by: linhaifeng <1371675203@qq.com>
```
  7901109e
- [XPU]Support AgRsAll2AllManager on XPU device (#32654) · 13f6630a
  YiSheng5 authored Jan 20, 2026
```
Signed-off-by: yisheng <yi.sheng@intel.com>
```
  13f6630a
- [4/N] Initialize MM components in context managers (M-P) (#32663) · fda3f03e
  Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fda3f03e
- [Metrics] Complete removal of deprecated vllm:time_per_output_token_seconds metric (#32661) · bb917203
  杨朱 · Kiki authored Jan 20, 2026
```
This PR completes the removal of the deprecated vllm:time_per_output_token_seconds
metric that was deprecated in v0.11, hidden in v0.12, scheduled for removal in v0.13,
but delayed until v0.15.
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Haiku 4.5 <noreply@anthropic.com>
```
  bb917203
- [Bugfix] Fix the fp8_mqa_logits dim mismatch (#32652) · c4e5bdf6
  Chauncey authored Jan 20, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  c4e5bdf6
- [3/N] Initialize MM components in context managers (I-L) (#32650) · 7f1bcd18
  Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7f1bcd18
- [Core] Cleanup shm based object store on engine shutdown (#32429) · 8be263c3
  Walter Beller-Morales authored Jan 20, 2026
```
Signed-off-by: walterbm <walter.beller.morales@gmail.com>
```
  8be263c3
- [2/N] Initialize MM components in context managers (E-H) (#32641) · e1a34c3a
  Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e1a34c3a
- [Refactor] Make FP8 Linear Ops use kernel abstraction (#27814) · 148117ea
  vllmellm authored Jan 20, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  148117ea
- [Model Runner V2] Skip kernel launch for penalties & logit_bias (#32634) · e9c83cdc
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e9c83cdc
- [1/N] Initialize MM components in context managers (A-D) (#32632) · b75e85de
  Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b75e85de
- [Model] Use context managers for encoder- and LM-only mode (#32605) · 4753f3bf
  Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4753f3bf
- [Model Runner V2] Decouple temperature from penalties (#32629) · 6c01ffb8
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6c01ffb8
- [Model Runner V2] Refactor get_cudagraph_and_dp_padding (#32625) · 7b7cdce9
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7b7cdce9
- [Feat] allow inplace loading lora (#31326) · 12dab78f
  Jackmin801 authored Jan 19, 2026
```
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Signed-off-by: Jackmin801 <56836461+Jackmin801@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  12dab78f
- [Model Runner V2] Initialized communication buffer for DP (#32624) · 05dc4bfa
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  05dc4bfa
19 Jan, 2026 3 commits

[Attention][MLA] Make FLASHINFER_MLA the default MLA backend on Blackwell, and... · 1a1fc3bb

Matthew Bonanni authored Jan 19, 2026


[Attention][MLA] Make FLASHINFER_MLA the default MLA backend on Blackwell, and TRTLLM the default prefill (#32615)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

1a1fc3bb

[Model Runner V2] Refactor `dummy_run` (#32533) · 43fada53
Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
43fada53
feat: spec decode with draft models (#24322) · 4a5299c9
Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
4a5299c9