Commits · 5f45b0b7e0564b92a12600b6a6965f3e723a8e62 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "936db119ed390fadc7de448261226358e153e46c"

02 Feb, 2026 4 commits

[Bugfix][ROCm] Fixing the skinny gemm dispatch logic from #32831 (#33366) · 5f45b0b7
Gregory Shtrasberg authored Jan 30, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
(cherry picked from commit 31aedfe7)
```
5f45b0b7
[Bugfix] Enable Triton MoE for FP8 per-tensor dynamic (#33300) · 6ff16b77
Michael Goin authored Jan 29, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
(cherry picked from commit bfb9bdaf)
```
6ff16b77

[Bugfix] Fix Qwen3-VL-Reranker load. (#33298) · 1ed963d4

wang.yuqi authored Jan 29, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
(cherry picked from commit abb34ac4)

1ed963d4

[Bugfix] Register fp8 cutlass_group_gemm as supported for only SM90+SM100 (#33285) · 39e8b493
Michael Goin authored Jan 28, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
(cherry picked from commit 1bd47d6e)
```
39e8b493

28 Jan, 2026 5 commits

Revert "Enable Cross layers KV cache layout at NIXL Connector (#30207)" (#33241) · fe18ce4d

Or Ozeri authored Jan 28, 2026


Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
(cherry picked from commit 2e8de867)

fe18ce4d

[BugFix] Fix P/D with non-MoE DP (#33037) · 7779de34

Nick Hill authored Jan 27, 2026


Signed-off-by: Nick Hill <nickhill123@gmail.com>
(cherry picked from commit 0cd259b2)

7779de34

[Bugfix] Fix DeepseekV32 `AssertionError: num_kv_heads == 1` (#33090) · 0d8ce320
Nicolò Lucchesi authored Jan 27, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
(cherry picked from commit 492a7983)
```
0d8ce320
[Bugfix] Disable CG for Whisper+FA2 (#33164) · d51e1f8b
Nicolò Lucchesi authored Jan 27, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
(cherry picked from commit 1f3a2c29)
```
d51e1f8b

[Models] Kimi-K2.5 (#33131) · 5042815a

Roger Wang authored Jan 26, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wanglinian <wanglinian@stu.pku.edu.cn>
Co-authored-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
(cherry picked from commit b539f988)

5042815a

26 Jan, 2026 9 commits
- [Bugfix] Fix Dtypes for Pynccl Wrapper (#33030) · cf1167e5
  Robert Shaw authored Jan 26, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
(cherry picked from commit 43a013c3)
```
  cf1167e5
- [Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  11b55687
- Set splitk=1 for fused-moe-lora expand kernel (#32882) · ee484b3f
  Danielle Robinson authored Jan 25, 2026
```
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ee484b3f
- [Model Runner V2] Add LoRAState to consolidate lora logic (#33062) · a9b53dd4
  Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  a9b53dd4
- [StepVL] support close img patch (#32923) · 105d1045
  ltd0924 authored Jan 26, 2026
```
Signed-off-by: luotingdan <luotingdan@stepfun.com>
Signed-off-by: ltd0924 <32387785+ltd0924@users.noreply.github.com>
Co-authored-by: luotingdan <luotingdan@stepfun.com>
```
  105d1045
- [CI] Fix MHA attention test failure (AttributeError when model_config is None... · 566cdb6c
  Lucas Wilkinson authored Jan 25, 2026
```
[CI] Fix MHA attention test failure (AttributeError when model_config is None in ViT attention backend) (#33033)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  566cdb6c
- [Model Runner V2] Minor simplification for finish_requests (#33048) · 2f0d3ba7
  Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  2f0d3ba7
- [Model Runner V2] Fix slot_mapping after #25954 (#33046) · edf927bc
  Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  edf927bc
- [Bugfix][VLM] Fix transformers backend embed_multimodal for Qwen2.5-VL profiling (#32969) · 22aeb430
  Andreas Karatzas authored Jan 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  22aeb430
25 Jan, 2026 4 commits

[Model] Use mm_position to compute mrope positions for Qwen2.5-Omni (#32772) · a698e8e7
Itay Etelis authored Jan 25, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
a698e8e7
[BugFix] Add env variable to control PDL in LoRA (#32836) · 73b24346
Jee Jee Li authored Jan 25, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
73b24346

[Bugfix] fix encoder cache hang in Qwen3VL (#32684) · 7e67df55

JJJYmmm authored Jan 25, 2026


Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7e67df55

[Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
fcb9df99

24 Jan, 2026 18 commits

[Feature] add session based streaming input support to v1 (#28973) · 91601ff4

Joshua Deng authored Jan 24, 2026


Signed-off-by: Joshua Deng <joshuakdeng@gmail.com>
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

91601ff4

Using max_loras + 1 to construct grid in fused_moe_lora (#32277) · d4dbb7af
yugong333 authored Jan 24, 2026
```
Signed-off-by: Yu Gong <yu3.gong@gmail.com>
```
d4dbb7af
[MLA] Fuse cat and qaunt for fp8 kv-cache (#32950) · da5e7b12
Lucas Wilkinson authored Jan 24, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
da5e7b12

[Bugfix]: resolve torch.compile cache conflict between mm_encoder_tp_modes (#32842) · 1209b784

Hiroken. authored Jan 24, 2026


Signed-off-by: Hongjian Zhang <zhanghongjian@xiaohongshu.com>
Signed-off-by: Xingran Wang <wangxingran123456@outlook.com>
Co-authored-by: Xingran Wang <wangxingran123456@outlook.com>

1209b784

[EncoderCacheManager] Remove unnecessary copy (#32800) · 5fa0f6ef
Lukas Geiger authored Jan 24, 2026
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
5fa0f6ef
feat: Complete LoRA support for MiniMaxM2 Fixes #32736 (#32763) · bc0d291b
david guan authored Jan 24, 2026
```
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
bc0d291b
[Models]: Make Multimodal config implicit in ViT implementation (#31972) · 9ad7f89f
Isotr0py authored Jan 24, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
9ad7f89f

[Bugfix] Fix E2E latency calculation and add warmup support in mm_processor benchmark (#32646) · 6450b536

Hiroken. authored Jan 24, 2026

Signed-off-by: Hongjian Zhang <zhanghongjian@xiaohongshu.com>
Signed-off-by: Xingran Wang <wangxingran123456@outlook.com>
Signed-off-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>
Co-authored-by: Xingran Wang <wangxingran123456@outlook.com>

6450b536

[Perf] Cache exc.errors() result in validation exception handler (#32984) · 0f19427d
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
0f19427d
[UX] Deduplicate sampling parameter startup logs (#32953) · 51931c5c
Cyrus Leung authored Jan 24, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
51931c5c

feat(benchmark): add encoder forward pass benchmarking to mm-processor (#31655) · 06b557ec

Reagan Lee authored Jan 24, 2026

Signed-off-by: Reagan <reaganjlee@gmail.com>
Signed-off-by: Reagan Lee <96998476+reaganjlee@users.noreply.github.com>
Co-authored-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>

06b557ec

[Models] Add `SharedFusedMoE` support to Qwen3MoE (#32082) · 8edaf385
Isotr0py authored Jan 24, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
8edaf385
[Tests] Standardize RNG seed utility across test files (#32982) · 0ccecf88
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
0ccecf88
[Perf] Cache xpu_get_mem_info() result to avoid duplicate calls (#32983) · 14d03b8d
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
14d03b8d
[ROCm][ViT] Enable Flash Attention Triton backend on RDNA3/RDNA4 (#32944) · 97ef11dd
monajafi-amd authored Jan 23, 2026
```
Signed-off-by: mohammad najafi <mohammad.najafi@amd.com>
```
97ef11dd
[Bugfix] Fix FusedMoE LoRA kernel offs_token out of bound value (#32279) · ecc3dd66
Xin Yang authored Jan 23, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
ecc3dd66
[Core][Bugfix] allow graceful worker termination (#32965) · 7e1f10d5
Joe Runde authored Jan 23, 2026
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
7e1f10d5

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6