Commits · 4de08ad698674560be7abebd9437d698d1216872 · OpenDAS / vllm_cscc

16 Dec, 2025 15 commits
- [CI/Build] Skip broken ViT backend functionality test tempoarily (#30782) · 4de08ad6
  Isotr0py authored Dec 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  4de08ad6
- [Bugfix] Whisper fix number of allocated CrossAttn blocks per-request (#30772) · 75eb302a
  Nicolò Lucchesi authored Dec 16, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  75eb302a
- [ROCm][MTP] Support MTP for AITER MLA backend (#28624) · 9dbbc59b
  Pleaplusone authored Dec 16, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  9dbbc59b
- update piecewise cudagraph warning when splitting_ops=[] (#30728) · 104003dc
  Boyuan Feng authored Dec 16, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  104003dc
- [ROCm] [AITER] [DOC] Add usage description about check functions in `_aiter_ops` (#30586) · d0fb5729
  TJian authored Dec 16, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  d0fb5729
- Don'e assume `position_embedding_type` will be present for BERT and RoBERTa models (#30770) · 6f15ac5d
  Harry Mellor authored Dec 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6f15ac5d
- [Bugfix] Fix prefix_repetition routing in bench throughput (#29663) · 676db55e
  Junru Shen authored Dec 16, 2025
```
Signed-off-by: Junru Shen <jrshen.sjr@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  676db55e
- [Bugfix] Fix RequestOutput miss lora_request (#30636) · 0e391e75
  Jee Jee Li authored Dec 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0e391e75
- [responsesAPI][8] input/output messages for ResponsesParser (#30158) · 0d0c929f
  Andrew Xia authored Dec 16, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  0d0c929f
- [Bugfix] Fix broken ViT attention selection for Blackwell device (#30731) · e94384bb
  Isotr0py authored Dec 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e94384bb
- [feature] extend DBO to XBO (#30120) · b9ff4f2a
  jiangkuaixue123 authored Dec 16, 2025
```
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: root <root@hk01dgx028.cm.cluster>
```
  b9ff4f2a
- improve lazy import test (#30733) · c881db36
  Boyuan Feng authored Dec 15, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c881db36
- [CustomOp] Extract ApplyRotaryEmb as CustomOp and unify the dispatch logic (#29873) · 3bd9c491
  Shanshan Shen authored Dec 16, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  3bd9c491
- [docker] Restructure Dockerfile for more efficient and cache-friendly builds (#30626) · ff21a0fc
  Amr Mahdi authored Dec 16, 2025
```
Signed-off-by: Amr Mahdi <amrmahdi@meta.com>
```
  ff21a0fc
- [Bugfix] fix streaming final output for non harmony (#30237) · bbd850e5
  penfree authored Dec 16, 2025
```
Signed-off-by: penfree <qiupengfei@baidu.com>
Co-authored-by: penfree <qiupengfei@baidu.com>
```
  bbd850e5
15 Dec, 2025 25 commits

[BUILD] use sm_100f when compiling flashmla to fix support on sm103 (#30705) · 511e81e7
Shengqi Chen authored Dec 16, 2025
```
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
511e81e7
[UX][Attention] Add `attention_config` argument to `LLM()` (#30710) · a182be43
Matthew Bonanni authored Dec 15, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
a182be43

[Benchmarks] `auto_tune.sh`: Use hostname variable for server requests (#30529) · c01d5898

Kevin Musgrave authored Dec 15, 2025

Signed-off-by: Kevin Musgrave <kevin.musgrave@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c01d5898

Update batch invariant to use attention config (#30704) · 60dbf7d8

Matthew Bonanni authored Dec 15, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

60dbf7d8

[Bugfix] Fail instead of ignoring when CompilationConfig gets invalid args (#30708) · a450c64a
Michael Goin authored Dec 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
a450c64a
[docs][fix] Update Arm CPU vLLM wheel installation docs (#30594) · b2191abd
Fadi Arafeh authored Dec 15, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
b2191abd
[Bugfix] Fix ViT with FlashAttention on ROCm (#30703) · 51e5b3e3
Matthew Bonanni authored Dec 15, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
51e5b3e3

[Platform] Refactor Platform attention backend selection to avoid breakpoint... · ec154c36

Isotr0py authored Dec 16, 2025


[Platform] Refactor Platform attention backend selection to avoid breakpoint for OOT platform (#30212)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ec154c36

Remove `SkipValidation` from `ModelConfig` (#30695) · 970713d4
Harry Mellor authored Dec 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
970713d4
[Bugfix] Fix missing first token in tool calls during reasoning-to-tool transition (#30671) · 17fec3af
mondaylord authored Dec 16, 2025
```
Signed-off-by: mondaylord <20212010046@fudan.edu.cn>
```
17fec3af

[Frontend] add tools for dsv32 developer role (#30040) · 855b101d

yjc9696 authored Dec 15, 2025


Signed-off-by: pridejcyang <pridejcyang@tencent.com>
Co-authored-by: pridejcyang <pridejcyang@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

855b101d

[MoE][Refactor 1/N] Separate Online Quantization (#30627) · d0502b49
Robert Shaw authored Dec 15, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
d0502b49
[Bugfix] Fix multimodal configuration for Qwen3VL MOE model (#30670) · 3f175f18
Max Hu authored Dec 15, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
```
3f175f18
[Refactor] [3/N] Move tool parser tests and run on CPU (#30693) · ed586e77
Cyrus Leung authored Dec 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ed586e77
[Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675) · 2a1776b7
Chauncey authored Dec 15, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
2a1776b7

[Misc][Hybrid allocator + kv connector] Optionally enable hybrid allocator +... · 185c22bf

Nicolò Lucchesi authored Dec 15, 2025


[Misc][Hybrid allocator + kv connector] Optionally enable hybrid allocator + KV cache connector (#29805)
Signed-off-by: NickLucche <nlucches@redhat.com>

185c22bf

[BugFix] Add embed_input_ids method to make QWenLMHeadModel a vllm model (#30674) · e4806d97
duke authored Dec 15, 2025
```
Signed-off-by: root <iwzbi@zju.edu.cn>
Co-authored-by: root <iwzbi@zju.edu.cn>
```
e4806d97
[Model] Automatic conversion of TokenClassification model (#30666) · 4429d934
wang.yuqi authored Dec 15, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
4429d934

typing: Add type hints to TurnMetrics class in context.py (#30552) · 33278073

ゆり authored Dec 15, 2025


Co-authored-by: zkexorability <zkexorability@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

33278073

[New Model] BAGEL support (AR only) (#28439) · 1adeb3b8

汪志鹏 authored Dec 15, 2025


Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

1adeb3b8

[XPU] fix Dockerfile.xpu, avoid wheel conflicts (#30662) · e3a1cd1c
Kunshang Ji authored Dec 15, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
e3a1cd1c

[Feat] Refactor for `parallel_config` in `FusedMoEModularKernel` (#30282) · 3778673e

Wentao Ye authored Dec 14, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

3778673e

[Bugfix] Drop empty tool_calls lists to keep assistant replies in chat template (#30648) · b337647a
Seokhyun An authored Dec 15, 2025
```
Signed-off-by: Seokhyun An <iamseokhyun@gmail.com>
```
b337647a
[Bugfix] Fix deepseek_v32 tokenizer_mode (#30658) · a524d1ba
Jee Jee Li authored Dec 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
a524d1ba

[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend... · 87b4d155

Shanshan Shen authored Dec 15, 2025


[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend of QwenVisionAttention with it. (#30125)
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

87b4d155