Commits · 7e67df5570e2afc6a92833096898689c91244fb6 · OpenDAS / vllm_cscc

25 Jan, 2026 4 commits

[Bugfix] fix encoder cache hang in Qwen3VL (#32684) · 7e67df55

JJJYmmm authored Jan 25, 2026


Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7e67df55

[Docs] Fix Apple silicon include path in CPU installation docs (#32977) · ff6c1da4
7. Sun authored Jan 25, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
ff6c1da4
[Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
fcb9df99
[DOC] [ROCm] Update doc for v0.14.1 (#32998) · 1ebdff41
TJian authored Jan 25, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
1ebdff41

24 Jan, 2026 27 commits

[Feature] add session based streaming input support to v1 (#28973) · 91601ff4

Joshua Deng authored Jan 24, 2026


Signed-off-by: Joshua Deng <joshuakdeng@gmail.com>
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

91601ff4

Using max_loras + 1 to construct grid in fused_moe_lora (#32277) · d4dbb7af
yugong333 authored Jan 24, 2026
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
```
d4dbb7af

[CPU] Improve CPU Docker build (#30953) · 203d0bc0

Maryam Tahhan authored Jan 24, 2026


Signed-off-by: Maryam Tahhan <mtahhan@redhat.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>

203d0bc0

[CPU Backend][BugFix] Fix failing Darwin pipelines (#33002) · 17ab54de
Fadi Arafeh authored Jan 24, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
17ab54de
[Tests] Replace flaky sleep with polling in test_background_cancel (#32986) · cd775bdb
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
cd775bdb
[MLA] Fuse cat and qaunt for fp8 kv-cache (#32950) · da5e7b12
Lucas Wilkinson authored Jan 24, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
da5e7b12

Update CPU doc according to feedback (#32963) · 719ac592

Louie Tsai authored Jan 24, 2026

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

719ac592

[Bugfix]: resolve torch.compile cache conflict between mm_encoder_tp_modes (#32842) · 1209b784

Hiroken. authored Jan 24, 2026


Signed-off-by: Hongjian Zhang <zhanghongjian@xiaohongshu.com>
Signed-off-by: Xingran Wang <wangxingran123456@outlook.com>
Co-authored-by: Xingran Wang <wangxingran123456@outlook.com>

1209b784

[EncoderCacheManager] Remove unnecessary copy (#32800) · 5fa0f6ef
Lukas Geiger authored Jan 24, 2026
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
5fa0f6ef
feat: Complete LoRA support for MiniMaxM2 Fixes #32736 (#32763) · bc0d291b
david guan authored Jan 24, 2026
```
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
bc0d291b
[Models]: Make Multimodal config implicit in ViT implementation (#31972) · 9ad7f89f
Isotr0py authored Jan 24, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
9ad7f89f

[Bugfix] Fix E2E latency calculation and add warmup support in mm_processor benchmark (#32646) · 6450b536

Hiroken. authored Jan 24, 2026

Signed-off-by: Hongjian Zhang <zhanghongjian@xiaohongshu.com>
Signed-off-by: Xingran Wang <wangxingran123456@outlook.com>
Signed-off-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>
Co-authored-by: Xingran Wang <wangxingran123456@outlook.com>

6450b536

[Perf] Cache exc.errors() result in validation exception handler (#32984) · 0f19427d
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
0f19427d
[UX] Deduplicate sampling parameter startup logs (#32953) · 51931c5c
Cyrus Leung authored Jan 24, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
51931c5c

feat(benchmark): add encoder forward pass benchmarking to mm-processor (#31655) · 06b557ec

Reagan Lee authored Jan 24, 2026

Signed-off-by: Reagan <reaganjlee@gmail.com>
Signed-off-by: Reagan Lee <96998476+reaganjlee@users.noreply.github.com>
Co-authored-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>

06b557ec

[Doc] Ignore typo check on doc (#32999) · 81c2a889
Roger Wang authored Jan 23, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
81c2a889
[Models] Add `SharedFusedMoE` support to Qwen3MoE (#32082) · 8edaf385
Isotr0py authored Jan 24, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
8edaf385

[docs] Update governance process links (#32995) · 5c86a898

Roy Wang authored Jan 24, 2026


Signed-off-by: esmeetu <jasonailu87@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>

5c86a898

[Tests] Standardize RNG seed utility across test files (#32982) · 0ccecf88
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
0ccecf88
[Tests] Clarify pytest skip reasons with actionable context (#32981) · 0b9a735e
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
0b9a735e
[Perf] Cache xpu_get_mem_info() result to avoid duplicate calls (#32983) · 14d03b8d
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
14d03b8d

[Dev UX] Add auto-detection for VLLM_PRECOMPILED_WHEEL_VARIANT during install (#32948) · d0cbac58

Michael Goin authored Jan 23, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Shengqi Chen <i@harrychen.xyz>

d0cbac58

Auth_token added in documentation as it is required (#32988) · c0d82045
ruizcrp authored Jan 24, 2026
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
c0d82045
[ROCm][ViT] Enable Flash Attention Triton backend on RDNA3/RDNA4 (#32944) · 97ef11dd
monajafi-amd authored Jan 23, 2026
```
Signed-off-by: mohammad najafi <mohammad.najafi@amd.com>
```
97ef11dd
[Bugfix] Fix FusedMoE LoRA kernel offs_token out of bound value (#32279) · ecc3dd66
Xin Yang authored Jan 23, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
ecc3dd66
[Core][Bugfix] allow graceful worker termination (#32965) · 7e1f10d5
Joe Runde authored Jan 23, 2026
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
7e1f10d5

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

23 Jan, 2026 9 commits
- [fix] add VLLM_OBJECT_STORAGE_SHM_BUFFER_NAME to compile factors (#32912) · 0118cdcc
  dolpm authored Jan 23, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  0118cdcc
- [CI] fix version comparsion and exclusion patterns in upload-release-wheels.sh (#32971) · 136c499f
  Shengqi Chen authored Jan 23, 2026
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  136c499f
- [Bugfix] Fix missing is_layer_skipped check for FusedMoE in AWQConfig (#32935) · ebd0a17e
  joninco authored Jan 23, 2026
```
Signed-off-by: jon <joninco@bullpoint.org>
```
  ebd0a17e
- [Refactor] Clean up unused variables & func (#32692) · 37c9859f
  Wentao Ye authored Jan 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  37c9859f
- [Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
  Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4561f139
- [CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure... · 6cc6d92b
  rasmith authored Jan 23, 2026
```
[CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure tensors passed will be made contiguous for the kernel (#32831)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  6cc6d92b
- [Bug] Fix benchmark script `moe_permute_unpermute` (#32949) · dfab5f37
  Wentao Ye authored Jan 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  dfab5f37
- fix: Add glm4_moe_lite to MLA detection (#32614) · 586a57ad
  Markus / Mark authored Jan 23, 2026
```
Signed-off-by: marksverdhei <marksverdhei@hotmail.com>
Signed-off-by: Markus / Mark <46672778+marksverdhei@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  586a57ad
- [cudagraphs] Refactor cudagraph capture loop (#32946) · 3a414595
  Lucas Wilkinson authored Jan 23, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3a414595