Commits · bc0a5a0c089844b17cb93f3294348f411e523586 · OpenDAS / vllm_cscc

24 Dec, 2025 1 commit
- [CI] Add Qwen3-Next-FP8 to Blackwell model tests (#31049) · bc0a5a0c
  Vadim Gimpelson authored Dec 24, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  bc0a5a0c
23 Dec, 2025 11 commits

[ROCm][Bugfix] Fix RuntimeError in MMEncoderAttention by replacing .view() with .reshape() (#31203) · bfa2c0bb
Andreas Karatzas authored Dec 23, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
bfa2c0bb

[Core] Add a random suffix to frontend-provided request IDs (#27987) · f7900686

Mark McLoughlin authored Dec 23, 2025


Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

f7900686

Fix edge case Mistral tool parser (#30724) · 38c361f9

Joachim Studnia authored Dec 23, 2025

Signed-off-by: Joachim Studnia <joachim@mistral.ai>
Signed-off-by: Joachim Studnia <studniajoachim@gmail.com>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: juliendenize <julien.denize@mistral.ai>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

38c361f9

[Misc] Introduce `encode_*_url` utility function (#31208) · bb62dda2
Cyrus Leung authored Dec 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
bb62dda2
adapt voxtral (#31095) · 3faa8bee
Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
3faa8bee

[Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54

Jakub Zakrzewski authored Dec 23, 2025


Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

23daef54

[ROCm][FEAT] Support AITER RMSNorm quantization fusion pass (#26575) · f32cfd7d
vllmellm authored Dec 23, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
f32cfd7d
[Chore] Update more locations to use `attention_config.backend` (#31153) · 8cef1376
Cyrus Leung authored Dec 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
8cef1376
Revert "[SM100] Enable fp8 compute for prefill MLA (#30746)" (#31197) · 3e102623
Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
3e102623
[ci] Fix Pytorch compilation test oom in 2.10 (#31194) · 612d5ffd
Angela Yi authored Dec 22, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
612d5ffd
[AMD][CI] fix v1/engine test_preprocess_error_handling (#31192) · 78e5e62b
Divakar Verma authored Dec 22, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
78e5e62b

22 Dec, 2025 11 commits
- [CI Failure] Disable mosaicml/mpt-7b and databricks/dbrx-instruct tests (#31182) · 6d518ffb
  Michael Goin authored Dec 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6d518ffb
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476
- [SM100] Enable fp8 compute for prefill MLA (#30746) · b10f41c8
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  b10f41c8
- [MoE Refactor][9/N] Use modular kernel for unquantized Triton MoE (#31052) · 7b926e89
  Yongye Zhu authored Dec 22, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  7b926e89
- [CI][Bugfix] Fix `entrypoints/openai/test_audio.py` (#31151) · b1c3f96a
  Nicolò Lucchesi authored Dec 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  b1c3f96a
- [CI] add polling for precompiled wheel in python_only_compile.sh, fix index... · 2cf91c2e
  Shengqi Chen authored Dec 22, 2025
```
[CI] add polling for precompiled wheel in python_only_compile.sh, fix index generation for releases (#30781)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  2cf91c2e
- [Misc] Fix grammar errors in comments and messages (#31115) · 42b42824
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  42b42824
- [Misc] Fix quantization-related typos (#31116) · ec58c10c
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  ec58c10c
- [Misc] Fix spelling typos in comments (#31114) · 8c084de5
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  8c084de5
- [Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN... · 19cc9468
  CedricHuang authored Dec 22, 2025
```
[Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN and FP8_PB_WO  in vLLM (#30957)
```
  19cc9468
- [Kernel] Enable fused_qknorm_rope_kernel supports partial rope (#30821) · 097978a1
  Jee Jee Li authored Dec 22, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  097978a1
21 Dec, 2025 2 commits

[MoE Refactor][4/N] Marlin Fp8 Mk (#31036) · b471092d
Robert Shaw authored Dec 21, 2025

b471092d

[BugFix]fix gpt-oss v1/completions response bug (#30608) · 3e92b2b7

汪志鹏 authored Dec 21, 2025


Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: bbrowning <bbrownin@redhat.com>

3e92b2b7

20 Dec, 2025 3 commits

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891) · 54c89243

baonudesifeizhai authored Dec 20, 2025

Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Signed-off-by: Dongjie Zou <85092850+baonudesifeizhai@users.noreply.github.com>
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

54c89243

[CI] FIx `fixture 'siglip_attention_config' not found` (#31053) · ff2168bc
Lucas Wilkinson authored Dec 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
ff2168bc

[Bugfix] fix the alias bug of AttentionBackendEnum when register CUSTOM... · d52c5096

zejunchen-zejun authored Dec 20, 2025


[Bugfix] fix the alias bug of AttentionBackendEnum when register CUSTOM attention backend to vllm (#30869)
Signed-off-by: zejunchen-zejun <zejun.chen@amd.com>

d52c5096

19 Dec, 2025 10 commits
- [MoE Refactor][3/N] Deprecate cutlass block quant fp8 (b200) (#30990) · 83a317f6
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  83a317f6
- Make engine core client handshake timeout configurable (#27444) · 1ab52135
  Seiji Eicher authored Dec 19, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  1ab52135
- [Model] Add MiMo-V2-Flash support (#30836) · 969bbc7c
  Zhonghua Deng authored Dec 20, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
Signed-off-by: Jumiar <liuanqim10@126.com>
Signed-off-by: Zyann7 <zyann7@outlook.com>
Co-authored-by: Jumiar <liuanqim10@126.com>
Co-authored-by: Zyann7 <zyann7@outlook.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  969bbc7c
- [Frontend][Bug] allow tool calls in analysis channel (#28139) · 45594967
  Marko Rosenmueller authored Dec 19, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  45594967
- [Bugfix] Add validation for tool requests when tool_parser is unavailable (#30613) · 086b9633
  lif authored Dec 19, 2025
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  086b9633
- Add hidden dimension validation for multimodal embedding inputs (#30968) · 4924ac58
  Wenqi Glantz authored Dec 19, 2025
```
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
```
  4924ac58
- [BugFix] Fix logprobs with spec decode and modified logits (#30846) · 2ac85a45
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ac85a45
- [ROCm][CI][Bugfix] Multi-Modal Model Support Fixes and Attention Backend Improvements (#30270) · 7b43db21
  Andreas Karatzas authored Dec 18, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  7b43db21
- [Bugfix] Fix tool_choice="none" being ignored by GPT-OSS/harmony models (#30867) · 6a09612b
  PlatinumGod authored Dec 19, 2025
```
Signed-off-by: yujiepu <pyjapple@gmail.com>
Signed-off-by: PlatinumGod <pyjapple@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  6a09612b
- [BugFix] Handle errors when preprocessing added requests (#30895) · 45c0526a
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  45c0526a
18 Dec, 2025 2 commits

Remove all2all backend envvar (#30363) · 41b6f920

Elizabeth Thomas authored Dec 18, 2025

Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

41b6f920

[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new... · 700a5ad6

Isotr0py authored Dec 19, 2025


[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new `MMEncoderAttention` interface (#30684)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

700a5ad6