Commits · c881db364e2bbcc90350db857fe294ae01ff71b7 · OpenDAS / vllm_cscc

16 Dec, 2025 2 commits

[CustomOp] Extract ApplyRotaryEmb as CustomOp and unify the dispatch logic (#29873) · 3bd9c491

Shanshan Shen authored Dec 16, 2025


Signed-off-by: shen-shanshan <467638484@qq.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

3bd9c491

[Bugfix] fix streaming final output for non harmony (#30237) · bbd850e5
penfree authored Dec 16, 2025
```
Signed-off-by: penfree <qiupengfei@baidu.com>
Co-authored-by: penfree <qiupengfei@baidu.com>
```
bbd850e5

15 Dec, 2025 24 commits
- [UX][Attention] Add `attention_config` argument to `LLM()` (#30710) · a182be43
  Matthew Bonanni authored Dec 15, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a182be43
- Update batch invariant to use attention config (#30704) · 60dbf7d8
  Matthew Bonanni authored Dec 15, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  60dbf7d8
- [Bugfix] Fail instead of ignoring when CompilationConfig gets invalid args (#30708) · a450c64a
  Michael Goin authored Dec 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a450c64a
- [Bugfix] Fix ViT with FlashAttention on ROCm (#30703) · 51e5b3e3
  Matthew Bonanni authored Dec 15, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  51e5b3e3
- [Platform] Refactor Platform attention backend selection to avoid breakpoint... · ec154c36
  Isotr0py authored Dec 16, 2025
```
[Platform] Refactor Platform attention backend selection to avoid breakpoint for OOT platform (#30212)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  ec154c36
- Remove `SkipValidation` from `ModelConfig` (#30695) · 970713d4
  Harry Mellor authored Dec 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  970713d4
- [Bugfix] Fix missing first token in tool calls during reasoning-to-tool transition (#30671) · 17fec3af
  mondaylord authored Dec 16, 2025
```
Signed-off-by: mondaylord <20212010046@fudan.edu.cn>
```
  17fec3af
- [Frontend] add tools for dsv32 developer role (#30040) · 855b101d
  yjc9696 authored Dec 15, 2025
```
Signed-off-by: pridejcyang <pridejcyang@tencent.com>
Co-authored-by: pridejcyang <pridejcyang@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  855b101d
- [MoE][Refactor 1/N] Separate Online Quantization (#30627) · d0502b49
  Robert Shaw authored Dec 15, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  d0502b49
- [Bugfix] Fix multimodal configuration for Qwen3VL MOE model (#30670) · 3f175f18
  Max Hu authored Dec 15, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
```
  3f175f18
- [Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675) · 2a1776b7
  Chauncey authored Dec 15, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  2a1776b7
- [Misc][Hybrid allocator + kv connector] Optionally enable hybrid allocator +... · 185c22bf
  Nicolò Lucchesi authored Dec 15, 2025
```
[Misc][Hybrid allocator + kv connector] Optionally enable hybrid allocator + KV cache connector (#29805)
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  185c22bf
- [BugFix] Add embed_input_ids method to make QWenLMHeadModel a vllm model (#30674) · e4806d97
  duke authored Dec 15, 2025
```
Signed-off-by: root <iwzbi@zju.edu.cn>
Co-authored-by: root <iwzbi@zju.edu.cn>
```
  e4806d97
- [Model] Automatic conversion of TokenClassification model (#30666) · 4429d934
  wang.yuqi authored Dec 15, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  4429d934
- typing: Add type hints to TurnMetrics class in context.py (#30552) · 33278073
  ゆり authored Dec 15, 2025
```
Co-authored-by: zkexorability <zkexorability@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  33278073
- [New Model] BAGEL support (AR only) (#28439) · 1adeb3b8
  汪志鹏 authored Dec 15, 2025
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  1adeb3b8
- [Feat] Refactor for `parallel_config` in `FusedMoEModularKernel` (#30282) · 3778673e
  Wentao Ye authored Dec 14, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  3778673e
- [Bugfix] Drop empty tool_calls lists to keep assistant replies in chat template (#30648) · b337647a
  Seokhyun An authored Dec 15, 2025
```
Signed-off-by: Seokhyun An <iamseokhyun@gmail.com>
```
  b337647a
- [Bugfix] Fix deepseek_v32 tokenizer_mode (#30658) · a524d1ba
  Jee Jee Li authored Dec 15, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a524d1ba
- [CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend... · 87b4d155
  Shanshan Shen authored Dec 15, 2025
```
[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend of QwenVisionAttention with it. (#30125)
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  87b4d155
- additional protection for CVE-2025-62164 (#30649) · 84e23d10
  Wenqi Glantz authored Dec 14, 2025
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
  84e23d10
- [CustomOp] Support object-level enable for CustomOp (#30547) · 738648fb
  Shanshan Shen authored Dec 15, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  738648fb
- [Log] Skip piecewise cudagraph warn when using full cudagraph (#30657) · 917fdae5
  Boyuan Feng authored Dec 14, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  917fdae5
- Revert "[Fix]Load kv-cache dtype from hf_quant_config.json automatically" (#30653) · e2ed2388
  Robert Shaw authored Dec 14, 2025
  
  e2ed2388
14 Dec, 2025 14 commits
- CPU KV Offloading: Use more CUDA streams (#29013) · 174e39ea
  Or Ozeri authored Dec 15, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  174e39ea
- [responsesAPI]add extra body parameters (#30532) · 9ccbf6b6
  RioS authored Dec 15, 2025
```
Signed-off-by: Ri0S <aa248424@gmail.com>
```
  9ccbf6b6
- [NIXL][BUG FIX] Fix a bug for PD with host_buffer after merging 29665 (#30420) · ae2e503d
  Chendi.Xue authored Dec 14, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  ae2e503d
- [Model][Quantization] Override HF defaults to GGUF ones (incl. Qwen3 MoE) (#30118) · 9e33a1a7
  Tsukasa OI authored Dec 15, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
  9e33a1a7
- [Bugfix][benchmarks] Fix input token calculation for rerank benchmark metrics (#30596) · add4b0ca
  Vensen authored Dec 14, 2025
```
Signed-off-by: vensen <vensenmu@gmail.com>
```
  add4b0ca
- [Feature]Add EVS (Efficient Video Sampling) Support for Qwen3-VL (#29752) · ae88aada
  ZiTian Zhao authored Dec 14, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
Co-authored-by: deitxfge <huhaibo1990@126.com>
```
  ae88aada
- [Bugfix] Improve error messages in ModelConfig validation (#30213) · 5ccf0efa
  yifant-code authored Dec 14, 2025
```
Signed-off-by: ytian218 <ytian218@bloomberg.net>
Co-authored-by: ytian218 <ytian218@bloomberg.net>
```
  5ccf0efa
- [Bugfix] Fix fusion for VL models (#30244) · 994acec0
  ElizaWszola authored Dec 14, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  994acec0
- [Bugfix] Revert Qwen2-VL part of change in #28271 (#30542) · 48b8456f
  zifeitong authored Dec 14, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
```
  48b8456f
- [Bugfix] Update get_processor_data to use get_all method (#30583) · 5b64ac21
  Drew Botwinick authored Dec 14, 2025
```
Signed-off-by: Drew Botwinick <6953152+dbotwinick@users.noreply.github.com>
```
  5b64ac21
- [Misc] Add a script to benchmark compilation time (#29919) · a8ec4865
  Bin Bao authored Dec 14, 2025
```
Signed-off-by: Bin Bao <binbao@meta.com>
```
  a8ec4865
- [Bugfix] fix _get_quant_method of FusedMoE for deepseekV3.2 on non-NV… (#30057) · 6ecc1e41
  tjp_zju authored Dec 14, 2025
```
Signed-off-by: tjp_zju <tanjianpingzju1990@gmail.com>
```
  6ecc1e41
- Nvidia ModelOpt workaround for issue 28072 (#30164) · 0bb0bae4
  Shengliang Xu authored Dec 14, 2025
```
Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>
```
  0bb0bae4
- fix: Update json features supported by xGrammar (#30390) · 06089365
  Johannes F authored Dec 14, 2025
```
Signed-off-by: Johannes Flommersfeld <johannes.flommersfeld@tngtech.com>
Signed-off-by: Johannes F <johannesflommersfeld@users.noreply.github.com>
Co-authored-by: Johannes Flommersfeld <johannes.flommersfeld@tngtech.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  06089365