Commits · 9ee05cbe7f29d72580f613553dcd2af8e770ccca · OpenDAS / vllm_cscc

26 Dec, 2025 2 commits

Support LoRA and GPTQModel for PLaMo 2/3 (#31322) · 9ee05cbe
Shinichi Hemmi authored Dec 26, 2025
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
```
9ee05cbe

oscardev256 authored Dec 25, 2025


Signed-off-by: oscardev256 <42308241+oscardev256@users.noreply.github.com>
Signed-off-by: Oscar Gonzalez <ogonzal6@alumni.jh.edu>
Signed-off-by: Yang <lymailforjob@gmail.com>
Co-authored-by: Yang <lymailforjob@gmail.com>

b7165d53

25 Dec, 2025 1 commit
- [Model][Ernie4.5-VL] Support video metadata for timestamp rendering (#31274) · 2d6001f4
  SongHe authored Dec 25, 2025
```
Signed-off-by: dengsonghe <dengsonghe@baidu.com>
Co-authored-by: dengsonghe <dengsonghe@baidu.com>
```
  2d6001f4
24 Dec, 2025 10 commits
- [Chore][1/2] Drop `v0.14` deprecations (#31285) · 09dc7c69
  Cyrus Leung authored Dec 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09dc7c69
- [Bugfix] Remove dead `block_quant_to_tensor_quant` function (#31294) · 506eb0f4
  ゆり authored Dec 25, 2025
```
Co-authored-by: yurekami <yurekami@users.noreply.github.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  506eb0f4
- [Bugfix][Hardware][AMD] Fix FP8 dtype in silu_mul quantization (#31179) · 66c98874
  Kevin McKay authored Dec 24, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  66c98874
- [Chore] Remove unused `noqa`s (#31263) · aa3868ec
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aa3868ec
- [Model] Introduce verify_and_update_model_config for VerifyAndUpdateConfig. (#31131) · bd89ce16
  wang.yuqi authored Dec 24, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  bd89ce16
- [Bugfix][ROCm] Fix load issue on deepseek quark quantization when shared expert enabled (#31261) · b41aeb34
  Pleaplusone authored Dec 24, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  b41aeb34
- [Qwen3-Omni] fixed _get_feat_extract_output_lengths function (#31007) · bb24592d
  Xiong Wang authored Dec 24, 2025
```
Signed-off-by: Xiong Wang <wangxiongts@163.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  bb24592d
- [ROCm][CI][Bugfix] Fix Siglip2 rotary embedding dispatch and InternVL video test tolerance (#31235) · e42894f5
  Andreas Karatzas authored Dec 23, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  e42894f5
- [Bug] Fix `Number of dimensions of tensors must match.` for Deepseek V3.2 (#31160) · 76e6a951
  Wentao Ye authored Dec 23, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  76e6a951
- [Bugfix] Enable `dynamic_dims` for different embeds shape (#31223) · dd424571
  Cyrus Leung authored Dec 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dd424571
23 Dec, 2025 6 commits
- [Mamba] - Consolidate Mambas Attention Logic (#28133) · 34916ae3
  Asaf Joseph Gardin authored Dec 23, 2025
  
  34916ae3
- adapt voxtral (#31095) · 3faa8bee
  Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  3faa8bee
- Add util function for checking nesting of rope parameters (#31146) · b10d47e0
  Harry Mellor authored Dec 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  b10d47e0
- [Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54
  Jakub Zakrzewski authored Dec 23, 2025
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  23daef54
- [Bugfix] Fix Jais2ForCausalLM (#31198) · 6b16fff0
  Jee Jee Li authored Dec 23, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  6b16fff0
- Revert "[SM100] Enable fp8 compute for prefill MLA (#30746)" (#31197) · 3e102623
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  3e102623
22 Dec, 2025 8 commits
- [MoE Refactor][7/N] AITER MK (#31102) · b57b9673
  Robert Shaw authored Dec 22, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  b57b9673
- [SM100] Enable fp8 compute for prefill MLA (#30746) · b10f41c8
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  b10f41c8
- [MoE Refactor][9/N] Use modular kernel for unquantized Triton MoE (#31052) · 7b926e89
  Yongye Zhu authored Dec 22, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  7b926e89
- [BugFix] skip language model in Encoder (#30242) · 8f8f469b
  dengyunyang authored Dec 22, 2025
```
Signed-off-by: dengyunyang <584797741@qq.com>
```
  8f8f469b
- [Model] Fix bagel failed to run (#31132) · 256a33ec
  Li Wang authored Dec 22, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  256a33ec
- [Bugfix][ROCm] Fix typo: is_linear_fp8_enaled -> is_linear_fp8_enabled (#31109) · cf8eed7b
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
  cf8eed7b
- [Misc] Fix spelling typos in model comments (#31117) · 14c3e6ad
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  14c3e6ad
- [Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN... · 19cc9468
  CedricHuang authored Dec 22, 2025
```
[Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN and FP8_PB_WO  in vLLM (#30957)
```
  19cc9468
21 Dec, 2025 1 commit
- [MoE Refactor][4/N] Marlin Fp8 Mk (#31036) · b471092d
  Robert Shaw authored Dec 21, 2025
  
  b471092d
20 Dec, 2025 5 commits

[Quantization] add marlin w4a8/w8a8 check (#31061) · 7c73ceb5
Jinzhen Lin authored Dec 21, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
```
7c73ceb5

[Quantization] support logical_widths for fp8 marlin (#30962) · ee52d990

Jinzhen Lin authored Dec 21, 2025

Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ee52d990

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891) · 54c89243

baonudesifeizhai authored Dec 20, 2025

Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Signed-off-by: Dongjie Zou <85092850+baonudesifeizhai@users.noreply.github.com>
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

54c89243

[XPU] enable fp8 online streaming quantization (#30944) · 560ae963
Yan Ma authored Dec 20, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
560ae963
GLM-4.7 Tool Parser and Doc Update (#30876) · 8a7a4143
Yuxuan Zhang authored Dec 20, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
8a7a4143

19 Dec, 2025 7 commits
- [MoE Refactor][2/N] Use Modular Kernels for Fp8 (#30825) · 95befecc
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  95befecc
- [Bug] Fix `error 'Dynamo failed to run FX node with fake tensors` for Deepseek V3.2 (#31046) · 4cf94298
  Wentao Ye authored Dec 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4cf94298
- [MoE Refactor][3/N] Deprecate cutlass block quant fp8 (b200) (#30990) · 83a317f6
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  83a317f6
- [Refactor] Refactor for `DeepGemmQuantScaleFMT` using cache (#30898) · 3bd8335b
  Wentao Ye authored Dec 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3bd8335b
- [Model] Add MiMo-V2-Flash support (#30836) · 969bbc7c
  Zhonghua Deng authored Dec 20, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
Signed-off-by: Jumiar <liuanqim10@126.com>
Signed-off-by: Zyann7 <zyann7@outlook.com>
Co-authored-by: Jumiar <liuanqim10@126.com>
Co-authored-by: Zyann7 <zyann7@outlook.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  969bbc7c
- [Quantization] fix marlin w8a8 check (#30961) · 5fbfa8d9
  Jinzhen Lin authored Dec 19, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
```
  5fbfa8d9
- [CustomOp][Refactor] Extract common methods for ApplyRotaryEmb CustomOp (#31021) · 23a1946e
  Shanshan Shen authored Dec 19, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  23a1946e