Commits · 1339878e137de9ee8e1f0cf945b6eb62f423c3c0 · OpenDAS / vllm_cscc

23 Dec, 2025 18 commits

Only patch `original_max_position_embeddings` for Transformers v4 (#31214) · 1339878e
Harry Mellor authored Dec 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
1339878e

[FIX] FP4 quantization kernel padding initialization bug (#31097) · b94f80ff

danielafrimi authored Dec 23, 2025



Signed-off-by: <>
Co-authored-by: root <root@gpu-193.slurm-workers-slurm.slurm.svc.cluster.local>
Co-authored-by: root <root@gpu-951.slurm-workers-slurm.slurm.svc.cluster.local>

b94f80ff

Fix edge case Mistral tool parser (#30724) · 38c361f9

Joachim Studnia authored Dec 23, 2025

Signed-off-by: Joachim Studnia <joachim@mistral.ai>
Signed-off-by: Joachim Studnia <studniajoachim@gmail.com>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: juliendenize <julien.denize@mistral.ai>
Co-authored-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

38c361f9

[Misc] Introduce `encode_*_url` utility function (#31208) · bb62dda2
Cyrus Leung authored Dec 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
bb62dda2
adapt voxtral (#31095) · 3faa8bee
Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
3faa8bee
Add util function for checking nesting of rope parameters (#31146) · b10d47e0
Harry Mellor authored Dec 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
b10d47e0
[OpenAI] Add parameter metadata to validation errors (#30134) · 769f27e7
R3hankhan authored Dec 23, 2025
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
769f27e7

[Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54

Jakub Zakrzewski authored Dec 23, 2025


Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

23daef54

[Bugfix] Fix MoE LoRA bin/pt loading (#31161) · 27c6c2f9
Jee Jee Li authored Dec 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
27c6c2f9
Correct position of docstring of class attributes (#31209) · 73cfb7a7
Weida Hong authored Dec 23, 2025
```
Signed-off-by: Weida Hong <wdhongtw@google.com>
```
73cfb7a7
[ROCm][FEAT] Support AITER RMSNorm quantization fusion pass (#26575) · f32cfd7d
vllmellm authored Dec 23, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
f32cfd7d
[Bugfix] Fix Jais2ForCausalLM (#31198) · 6b16fff0
Jee Jee Li authored Dec 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
6b16fff0

[XPU] decrease IGC_ForceOCLSIMDWidth for speculative decoding triton-xpu... · f1c2c201

Yan Ma authored Dec 23, 2025


[XPU] decrease IGC_ForceOCLSIMDWidth for speculative decoding triton-xpu kernel compilation (#30538)
Signed-off-by: Yan Ma <yan.ma@intel.com>

f1c2c201

[Chore] Update more locations to use `attention_config.backend` (#31153) · 8cef1376
Cyrus Leung authored Dec 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
8cef1376
[Feature] Batch invariant: Lora (#30097) · a37328fc
liuquan authored Dec 23, 2025
```
Signed-off-by: quanliu <18646313696@163.com>
```
a37328fc
Revert "[SM100] Enable fp8 compute for prefill MLA (#30746)" (#31197) · 3e102623
Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
3e102623
[ci] Fix Pytorch compilation test oom in 2.10 (#31194) · 612d5ffd
Angela Yi authored Dec 22, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
612d5ffd
[AMD][CI] fix v1/engine test_preprocess_error_handling (#31192) · 78e5e62b
Divakar Verma authored Dec 22, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
78e5e62b

22 Dec, 2025 22 commits
- [MoE Refactor][7/N] AITER MK (#31102) · b57b9673
  Robert Shaw authored Dec 22, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  b57b9673
- [CI Failure] Disable mosaicml/mpt-7b and databricks/dbrx-instruct tests (#31182) · 6d518ffb
  Michael Goin authored Dec 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6d518ffb
- [Perf] Remove blocking copy in GDN Attention (#31167) · 85aff45e
  Benjamin Chislett authored Dec 22, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  85aff45e
- [Bug] Fix `'CutlassMLAImpl' object has no attribute '_workspace_buffer'` (#31173) · 5312a728
  Wentao Ye authored Dec 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5312a728
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476
- [Doc] Add vllm-metal to hardware plugin documentation (#31174) · 95863540
  Michael Goin authored Dec 22, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  95863540
- [SM100] Enable fp8 compute for prefill MLA (#30746) · b10f41c8
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  b10f41c8
- [MoE Refactor][9/N] Use modular kernel for unquantized Triton MoE (#31052) · 7b926e89
  Yongye Zhu authored Dec 22, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  7b926e89
- [ROCm][CI/Build] Fix triton version to one that has triton_kernels required... · ab3a85fd
  Gregory Shtrasberg authored Dec 22, 2025
```
[ROCm][CI/Build] Fix triton version to one that has triton_kernels required for gpt-oss to run (#31159)
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  ab3a85fd
- [UX] improve profiler error message (#31125) · 8dd0db68
  Boyuan Feng authored Dec 22, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  8dd0db68
- [ROCm] [Critical]: Remove unused variable (#31156) · 022f3cea
  TJian authored Dec 23, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  022f3cea
- [AMD][CI] Add "V1 Test e2e + engine" to mi325_8 Agent Pool (#31040) · a5bc77c2
  Micah Williamson authored Dec 22, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  a5bc77c2
- [CI][Bugfix] Fix `entrypoints/openai/test_audio.py` (#31151) · b1c3f96a
  Nicolò Lucchesi authored Dec 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  b1c3f96a
- [BugFix] skip language model in Encoder (#30242) · 8f8f469b
  dengyunyang authored Dec 22, 2025
```
Signed-off-by: dengyunyang <584797741@qq.com>
```
  8f8f469b
- [CI] add polling for precompiled wheel in python_only_compile.sh, fix index... · 2cf91c2e
  Shengqi Chen authored Dec 22, 2025
```
[CI] add polling for precompiled wheel in python_only_compile.sh, fix index generation for releases (#30781)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  2cf91c2e
- [gpt-oss] Fix harmony parser in streaming responses (#30205) · bd6d5a74
  AlonKejzman authored Dec 22, 2025
```
Signed-off-by: AlonKejzman <alonkeizman@gmail.com>
```
  bd6d5a74
- [Model] Fix bagel failed to run (#31132) · 256a33ec
  Li Wang authored Dec 22, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  256a33ec
- Update MiniMax-M2 ToolCall and add MiniMax-M2.1 in Docs (#31083) · c02a2705
  Roger Young authored Dec 22, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
  c02a2705
- [Bugfix][ROCm] Fix typo: is_linear_fp8_enaled -> is_linear_fp8_enabled (#31109) · cf8eed7b
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
  cf8eed7b
- [Misc] Fix typo: 'occured' -> 'occurred' (#31120) · 44ae85f7
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  44ae85f7
- [Misc] Fix spelling typos in model comments (#31117) · 14c3e6ad
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  14c3e6ad
- [Misc] Fix grammar errors in comments and messages (#31115) · 42b42824
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  42b42824