Commits · b2eb84de77d759b1689bf7e567eeb2ae1a1050d7 · OpenDAS / vllm_cscc

18 Dec, 2025 7 commits
- [Bugfix] Remove `tile_size=64` for mm_prefix triton attention (#30973) · b2eb84de
  Isotr0py authored Dec 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
(cherry picked from commit d2dc5dfc)
```
  b2eb84de
- adds jais 2 support (#30188) · ac43367c
  sarathc-cerebras authored Dec 18, 2025
```
Signed-off-by: sarathc-cerebras <sarath.chandran@cerebras.net>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
(cherry picked from commit 28d15ab5)
```
  ac43367c
- [Fix][FlexAttention] return max logical block index to handle reused blocks (#30915) · 30fe765e
  Yifan Qiao authored Dec 17, 2025
```
Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
(cherry picked from commit 11a89cf9)
```
  30fe765e
- [BugFix] Partial revert of #29558 (DeepEP HT + PIECEWISE CG support) (#30910) · 2c0ee0fd
  Lucas Wilkinson authored Dec 18, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
(cherry picked from commit 30bb19a7)
```
  2c0ee0fd
- [v1] Add PrefixLM support to TritonAttention backend (#30386) · 55f1fc1b
  Isotr0py authored Dec 18, 2025
```
(cherry picked from commit 74a1ac38)
```
  55f1fc1b
- [BugFix] Workspace allocation during profile run : DeepEPHighThroughput + DeepGEMM (#30899) · 17f39880
  Varun Sundar Rabindranath authored Dec 17, 2025
```
(cherry picked from commit e3fc374a)
```
  17f39880
- [CI][Bugfix] Fix flaky `tests/entrypoints/openai/test_audio.py::test_chat_streaming_audio` (#30878) · 682c3858
  Nicolò Lucchesi authored Dec 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
(cherry picked from commit 9ca8cb38)
```
  682c3858
17 Dec, 2025 9 commits

[XPU] fix broken fp8 online quantization for XPU platform (#30831) · f124b567
Yan Ma authored Dec 17, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
(cherry picked from commit 4f735bab)
```
f124b567

[Bugfix][CPU] Fix CPU backend ROPE dispatch for VL models (#30829) · d78e128b

Li, Jiang authored Dec 17, 2025


Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
(cherry picked from commit 0cd53536)

d78e128b

[BugFix] Fix memory spike in workspace allocation (#30744) · 761b730d

Lucas Wilkinson authored Dec 16, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
(cherry picked from commit 00a8d762)

761b730d

[ROCm] [Bugfix] Fix torch sdpa hallucination (#30789) · f34eca5f
TJian authored Dec 17, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
(cherry picked from commit 2410132b)
```
f34eca5f

[CI] Skip ci failure test (#30804) · 4cd332f3

Wentao Ye authored Dec 16, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
(cherry picked from commit b6ec077e)

4cd332f3

[Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475) · 16484d39

Roger Wang authored Dec 16, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Sun Kim <sunytokki@gmail.com>
(cherry picked from commit f5f51e59)

16484d39

[CI/Build] Skip broken ViT backend functionality test tempoarily (#30782) · e397bd65
Isotr0py authored Dec 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
(cherry picked from commit 4de08ad6)
```
e397bd65
[Bugfix] Fix broken ViT attention selection for Blackwell device (#30731) · 6a88d590
Isotr0py authored Dec 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
(cherry picked from commit e94384bb)
```
6a88d590

[CustomOp] Extract ApplyRotaryEmb as CustomOp and unify the dispatch logic (#29873) · ad8c0731

Shanshan Shen authored Dec 16, 2025


Signed-off-by: shen-shanshan <467638484@qq.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
(cherry picked from commit 3bd9c491)

ad8c0731

15 Dec, 2025 24 commits

[Benchmarks] `auto_tune.sh`: Use hostname variable for server requests (#30529) · c01d5898

Kevin Musgrave authored Dec 15, 2025

Signed-off-by: Kevin Musgrave <kevin.musgrave@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c01d5898

Update batch invariant to use attention config (#30704) · 60dbf7d8

Matthew Bonanni authored Dec 15, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

60dbf7d8

[Bugfix] Fail instead of ignoring when CompilationConfig gets invalid args (#30708) · a450c64a
Michael Goin authored Dec 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
a450c64a
[docs][fix] Update Arm CPU vLLM wheel installation docs (#30594) · b2191abd
Fadi Arafeh authored Dec 15, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
b2191abd
[Bugfix] Fix ViT with FlashAttention on ROCm (#30703) · 51e5b3e3
Matthew Bonanni authored Dec 15, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
51e5b3e3

[Platform] Refactor Platform attention backend selection to avoid breakpoint... · ec154c36

Isotr0py authored Dec 16, 2025


[Platform] Refactor Platform attention backend selection to avoid breakpoint for OOT platform (#30212)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ec154c36

Remove `SkipValidation` from `ModelConfig` (#30695) · 970713d4
Harry Mellor authored Dec 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
970713d4
[Bugfix] Fix missing first token in tool calls during reasoning-to-tool transition (#30671) · 17fec3af
mondaylord authored Dec 16, 2025
```
Signed-off-by: mondaylord <20212010046@fudan.edu.cn>
```
17fec3af

[Frontend] add tools for dsv32 developer role (#30040) · 855b101d

yjc9696 authored Dec 15, 2025


Signed-off-by: pridejcyang <pridejcyang@tencent.com>
Co-authored-by: pridejcyang <pridejcyang@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

855b101d

[MoE][Refactor 1/N] Separate Online Quantization (#30627) · d0502b49
Robert Shaw authored Dec 15, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
d0502b49
[Bugfix] Fix multimodal configuration for Qwen3VL MOE model (#30670) · 3f175f18
Max Hu authored Dec 15, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
```
3f175f18
[Refactor] [3/N] Move tool parser tests and run on CPU (#30693) · ed586e77
Cyrus Leung authored Dec 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ed586e77
[Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675) · 2a1776b7
Chauncey authored Dec 15, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
2a1776b7

[Misc][Hybrid allocator + kv connector] Optionally enable hybrid allocator +... · 185c22bf

Nicolò Lucchesi authored Dec 15, 2025


[Misc][Hybrid allocator + kv connector] Optionally enable hybrid allocator + KV cache connector (#29805)
Signed-off-by: NickLucche <nlucches@redhat.com>

185c22bf

[BugFix] Add embed_input_ids method to make QWenLMHeadModel a vllm model (#30674) · e4806d97
duke authored Dec 15, 2025
```
Signed-off-by: root <iwzbi@zju.edu.cn>
Co-authored-by: root <iwzbi@zju.edu.cn>
```
e4806d97
[Model] Automatic conversion of TokenClassification model (#30666) · 4429d934
wang.yuqi authored Dec 15, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
4429d934

typing: Add type hints to TurnMetrics class in context.py (#30552) · 33278073

ゆり authored Dec 15, 2025


Co-authored-by: zkexorability <zkexorability@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

33278073

[New Model] BAGEL support (AR only) (#28439) · 1adeb3b8

汪志鹏 authored Dec 15, 2025


Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

1adeb3b8

[XPU] fix Dockerfile.xpu, avoid wheel conflicts (#30662) · e3a1cd1c
Kunshang Ji authored Dec 15, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
e3a1cd1c

[Feat] Refactor for `parallel_config` in `FusedMoEModularKernel` (#30282) · 3778673e

Wentao Ye authored Dec 14, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

3778673e

[Bugfix] Drop empty tool_calls lists to keep assistant replies in chat template (#30648) · b337647a
Seokhyun An authored Dec 15, 2025
```
Signed-off-by: Seokhyun An <iamseokhyun@gmail.com>
```
b337647a
[Bugfix] Fix deepseek_v32 tokenizer_mode (#30658) · a524d1ba
Jee Jee Li authored Dec 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
a524d1ba

[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend... · 87b4d155

Shanshan Shen authored Dec 15, 2025


[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend of QwenVisionAttention with it. (#30125)
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

87b4d155

additional protection for CVE-2025-62164 (#30649) · 84e23d10
Wenqi Glantz authored Dec 14, 2025
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
84e23d10