Commits · 9fec0e13d512b6b9082e40297582d8052f434610 · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "6b2d25efc78f21867ca37e3f707c5a94f906478f"

16 Dec, 2025 12 commits
- [Attention] Cache attention metadata builds across hybrid KV-cache groups (#29627) · 9fec0e13
  Lucas Wilkinson authored Dec 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
  9fec0e13
- [Refactor] Small refactor for group topk (#30562) · f21f5ea3
  Wentao Ye authored Dec 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  f21f5ea3
- [Frontend] Add `max-completion-token` option to transcription/translation endpoints (#30769) · ca702a14
  Nicolò Lucchesi authored Dec 16, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  ca702a14
- [CI] Generalize gsm8k test args and add Qwen3-Next MTP B200 test (#30723) · 10ee1c64
  Michael Goin authored Dec 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  10ee1c64
- Fix instantiation of `HfHubHTTPError` in LoRA test (#30768) · af506fd7
  Harry Mellor authored Dec 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  af506fd7
- [CI/Build] Skip broken ViT backend functionality test tempoarily (#30782) · 4de08ad6
  Isotr0py authored Dec 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  4de08ad6
- [Bugfix] Fix RequestOutput miss lora_request (#30636) · 0e391e75
  Jee Jee Li authored Dec 16, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0e391e75
- [responsesAPI][8] input/output messages for ResponsesParser (#30158) · 0d0c929f
  Andrew Xia authored Dec 16, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  0d0c929f
- [feature] extend DBO to XBO (#30120) · b9ff4f2a
  jiangkuaixue123 authored Dec 16, 2025
```
Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: root <root@hk01dgx028.cm.cluster>
```
  b9ff4f2a
- improve lazy import test (#30733) · c881db36
  Boyuan Feng authored Dec 15, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c881db36
- [CustomOp] Extract ApplyRotaryEmb as CustomOp and unify the dispatch logic (#29873) · 3bd9c491
  Shanshan Shen authored Dec 16, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  3bd9c491
- [Bugfix] fix streaming final output for non harmony (#30237) · bbd850e5
  penfree authored Dec 16, 2025
```
Signed-off-by: penfree <qiupengfei@baidu.com>
Co-authored-by: penfree <qiupengfei@baidu.com>
```
  bbd850e5
15 Dec, 2025 8 commits

[Bugfix] Fail instead of ignoring when CompilationConfig gets invalid args (#30708) · a450c64a
Michael Goin authored Dec 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
a450c64a
[Refactor] [3/N] Move tool parser tests and run on CPU (#30693) · ed586e77
Cyrus Leung authored Dec 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ed586e77
[Refactor] [2/N] Move tool parsers into the vLLM main directory (#30675) · 2a1776b7
Chauncey authored Dec 15, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
2a1776b7
[Model] Automatic conversion of TokenClassification model (#30666) · 4429d934
wang.yuqi authored Dec 15, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
4429d934

[New Model] BAGEL support (AR only) (#28439) · 1adeb3b8

汪志鹏 authored Dec 15, 2025


Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

1adeb3b8

[Feat] Refactor for `parallel_config` in `FusedMoEModularKernel` (#30282) · 3778673e

Wentao Ye authored Dec 14, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

3778673e

[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend... · 87b4d155

Shanshan Shen authored Dec 15, 2025


[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend of QwenVisionAttention with it. (#30125)
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

87b4d155

additional protection for CVE-2025-62164 (#30649) · 84e23d10
Wenqi Glantz authored Dec 14, 2025
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
84e23d10

14 Dec, 2025 9 commits

CPU KV Offloading: Use more CUDA streams (#29013) · 174e39ea
Or Ozeri authored Dec 15, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
174e39ea

[NIXL][BUG FIX] Fix a bug for PD with host_buffer after merging 29665 (#30420) · ae2e503d

Chendi.Xue authored Dec 14, 2025


Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>

ae2e503d

[Bugfix] Fix fusion for VL models (#30244) · 994acec0
ElizaWszola authored Dec 14, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
994acec0

fix: Update json features supported by xGrammar (#30390) · 06089365

Johannes F authored Dec 14, 2025

Signed-off-by: Johannes Flommersfeld <johannes.flommersfeld@tngtech.com>
Signed-off-by: Johannes F <johannesflommersfeld@users.noreply.github.com>
Co-authored-by: Johannes Flommersfeld <johannes.flommersfeld@tngtech.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

06089365

[Bugfix] awq_gemm: fix argument order swap (#30364) · e9add129

Matthias Gehre authored Dec 14, 2025


Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

e9add129

Add AudioFlamingo3 model support (#30539) · 3a20450d

Lasha Koroshinadze authored Dec 14, 2025


Signed-off-by: Lasha <26011196+lashahub@users.noreply.github.com>
Signed-off-by: Lasha Koroshinadze <26011196+lashahub@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3a20450d

[Chore] Remove redundant `RequestPrompt` (#30612) · dcb31196
Cyrus Leung authored Dec 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
dcb31196
enable unbacked with aot_compile (#30462) · f569c654
Laith Sakka authored Dec 14, 2025
```
Signed-off-by: Laith Sakka <lsakka@meta.com>
```
f569c654
Improve parse_raw_prompt test cases for invalid input .v2 (#30512) · 29f7d977
Kayvan Mivehnejad authored Dec 13, 2025
```
Signed-off-by: Kayvan Mivehnejad <K.Mivehnejad@gmail.com>
```
29f7d977

13 Dec, 2025 7 commits
- [Refactor] `TokenizerRegistry` only uses lazy imports (#30609) · 39cefbdf
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39cefbdf
- [CI/Build] Fix broken mm processor test Mistral-3-large (#30597) · e5db3e27
  Isotr0py authored Dec 13, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e5db3e27
- [Chore] Adjust tokenizer import to avoid circular imports (#30601) · 64251f48
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64251f48
- [Bugfix] Dictionary MM embeddings for online chat (#30507) · b09806e2
  Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b09806e2
- [Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46
  Roberto L. Castro authored Dec 13, 2025
```
Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  4fa7ce46
- [CI] Whisper logprobs tests (#30504) · 57e9bf18
  Nicolò Lucchesi authored Dec 13, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  57e9bf18
- [CI] Update several models in registry that are available online now (#30514) · 2f32a68d
  Michael Goin authored Dec 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  2f32a68d
12 Dec, 2025 4 commits
- [CI/Build][Kernel][BugFix][AMD] Fix per_token_group_quant_fp8 to use correct... · 08f8a562
  rasmith authored Dec 12, 2025
```
[CI/Build][Kernel][BugFix][AMD] Fix per_token_group_quant_fp8 to use correct fp8 min/max values and update atol/rtol in test_quantfp8_group_functionality  (#30292)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  08f8a562
- [ROCm] Enable Triton ScaledMM fallback + kernel selection fix (#26668) · cd7740ac
  shivampr authored Dec 12, 2025
```
Signed-off-by: Shivam <shivampr.dev@gmail.com>
Signed-off-by: Shivam <shivamprasad91@gmail.com>
```
  cd7740ac
- [bugfix] fix bug when top_logprobs=0 with spec decoding (#30059) · d2c919dc
  realliujiaxu authored Dec 13, 2025
```
Signed-off-by: realliujiaxu <realliujiaxu@163.com>
```
  d2c919dc
- [Frontend] Fixes anthropic streaming message_start usage nesting (#30266) · f3237f3f
  Benjamin Bartels authored Dec 12, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  f3237f3f