Commits · 13618626dff735a794cae3dec4ac4c3d78de2e86 · OpenDAS / vllm_cscc

12 Dec, 2025 9 commits

[MoE-FP8-modelopt] Add FlashInfer alignment padding for intermediate dimensions (#29748) · 13618626

danielafrimi authored Dec 12, 2025


Signed-off-by: Daniel Afrimi <dafrimi@pool0-00589.cm.cluster>
Signed-off-by: dafrimi <dafrimi@nvidia.com>
Co-authored-by: Daniel Afrimi <dafrimi@pool0-00589.cm.cluster>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

13618626

[Perf] Set split_k to 1 for triton_kernels (#30528) · 1f19d8f8
Xin Yang authored Dec 12, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
1f19d8f8
[ROCm] Enable Triton ScaledMM fallback + kernel selection fix (#26668) · cd7740ac
shivampr authored Dec 12, 2025
```
Signed-off-by: Shivam <shivampr.dev@gmail.com>
Signed-off-by: Shivam <shivamprasad91@gmail.com>
```
cd7740ac

fix(gguf): Disable bfloat16 for GGUF on blackwell device (#30408) · dc13c99e

Christina Norman authored Dec 12, 2025


Signed-off-by: Christina <truffle@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Christina Norman <christina@example.com>
Co-authored-by: Isotr0py <isotr0py@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

dc13c99e

[Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
3e41992f
[Bugfix] Schedule failure due to wrong get_image_size_with_most_features (#29692) · f90319d5
Jaehwang Jung authored Dec 12, 2025

f90319d5

[Bugfix][Model] Fix Afmoe rope_parameters issue (#30505) · 9f2fc16a

Michael Goin authored Dec 11, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

9f2fc16a

gptq marlin quantization support for fused moe with lora (#30254) · 6a6fc41c
Bhanu Prakash Voutharoja authored Dec 12, 2025
```
Signed-off-by: Bhanu068 <voutharoja.bhanu06@gmail.com>
```
6a6fc41c
[fix] fix SM check for Flashinfer TRTLLM MOE (#30314) · 0ab23c2b
jiahanc authored Dec 11, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
0ab23c2b

11 Dec, 2025 12 commits
- [EPLB] Support EPLB w/ NVFP4 (#29804) · a00d8897
  Andrew Briand authored Dec 11, 2025
```
Signed-off-by: Andrew Briand <abriand@nvidia.com>
Co-authored-by: Andrew Briand <abriand@nvidia.com>
```
  a00d8897
- [Perf] Optimize deepgemm experts initialization, 3.9% TTFT improvement (#30494) · c817b141
  Wentao Ye authored Dec 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: li-jinpeng <3332126450@qq.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  c817b141
- [Core] Whisper Enable Encoder Batching (#29421) · 0efd9f86
  Nicolò Lucchesi authored Dec 11, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0efd9f86
- Standardise `get_rope` to use `rope_parameters["partial_rotary_factor"]`, not `rotary_dim` (#30389) · cf3eacfe
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cf3eacfe
- [Feature] AWQ marlin quantization support for fused moe with lora (#30442) · 0e71eaa6
  汪志鹏 authored Dec 12, 2025
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  0e71eaa6
- Add Eagle and Eagle3 support to Transformers modeling backend (#30340) · 8781cd6b
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8781cd6b
- Give pooling examples better names (#30488) · 93db3256
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  93db3256
- [Misc] Improve error message for `is_multimodal` (#30483) · 3a3b06ee
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3a3b06ee
- [Deprecation] Remove missed fallback for `embed_input_ids` (#30469) · 13d63b65
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13d63b65
- [Deprecation] Remove fallbacks for `embed_input_ids` and `embed_multimodal` (#30458) · 979f50ef
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  979f50ef
- Ensure minimum frames for GLM 4.6V compatibility (#30285) · 36c9ce25
  gh-wf authored Dec 11, 2025
```
Signed-off-by: Wayne Ferguson <wayneferguson@gmail.com>
```
  36c9ce25
- [Bugfix] Fix grouped_topk pytorch impl when num_experts can't be grouped properly (#29439) · d1e1fb43
  Divakar Verma authored Dec 10, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  d1e1fb43
10 Dec, 2025 6 commits
- [Bugfix] Fix HunyuanOCR cross-image contamination in batch processing (#30344) · e8e8cd73
  Anker authored Dec 10, 2025
```
Signed-off-by: Lennart Brog <lennart.borg@list-ag.de>
Signed-off-by: Anker <20343812+anker-c2@users.noreply.github.com>
```
  e8e8cd73
- [BugFix] Fix `AttributeError: 'MergedColumnParallelLinear' object has no... · aacf0abf
  Lucas Wilkinson authored Dec 10, 2025
```
[BugFix] Fix `AttributeError: 'MergedColumnParallelLinear' object has no attribute 'weight_scale'` (#30399)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  aacf0abf
- [BugFix] Fix minimax m2 model rotary_dim (#30384) · d017bceb
  Roger Young authored Dec 10, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
  d017bceb
- Fix typos in comments across multiple files (#30345) · 3bdd4266
  Wilson Wu authored Dec 10, 2025
```
Signed-off-by: Wilson Wu <iwilsonwu@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  3bdd4266
- [bugfix][quantization] fix quark qwen3 kv_cache quantization (#30308) · 06462392
  haoyangli-amd authored Dec 10, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
```
  06462392
- [Bugfix] Fix fp8 DeepGemm compilation issues (#30336) · 2e7035dd
  ElizaWszola authored Dec 10, 2025
  
  2e7035dd
09 Dec, 2025 13 commits

[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block... · 3c680f4a

Charlie Fu authored Dec 09, 2025


[Rocm][torch.compile] Adding layernorm + fp8 block quant and silu + fp8 block quant for Aiter (#25693)
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Signed-off-by: Charlie Fu <Charlie.Fu@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: wuhuikx <hattie.wu@amd.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

3c680f4a

[Quantization] FP8 Weight Reloading for Quantized RL Rollout (#28480) · fccd5325
Kyle Sayers authored Dec 09, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
fccd5325

[MoE][Refactor] Remove most arguments to FusedMoEMethodBase.apply (#29066) · 00e5cbb9

bnellnm authored Dec 09, 2025

Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

00e5cbb9

[Model][Quantization] Fix / Add GGUF support for Qwen2 MoE models (#30307) · 73a484ca
Tsukasa OI authored Dec 10, 2025
```
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
```
73a484ca

[Feature] Batch-Invariant Support for FA2 and LoRA (#30018) · 5dcd593b

liuquan authored Dec 09, 2025


Signed-off-by: quanliu <18646313696@163.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

5dcd593b

[ROCm] Aiter Quant Kernels (#25552) · ee14644b
vllmellm authored Dec 09, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
ee14644b
[Bugfix]: Fix glm46 awq marlin moe wna16 compatibility (#30210) · 1166c31c
Dongjie Zou authored Dec 09, 2025
```
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
```
1166c31c

[Bugfix] Qwen 3 VL Embedding loading (#30303) · 9c32df61

wang.yuqi authored Dec 09, 2025

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

9c32df61

[Model][Quantization] Restore MoE + GGUF models support (incl. Qwen3 MoE) by... · 58d5b3f5

Tsukasa OI authored Dec 09, 2025


[Model][Quantization] Restore MoE + GGUF models support (incl. Qwen3 MoE) by allowing Sideload Parameters (#30116)
Signed-off-by: Tsukasa OI <floss_llm@irq.a4lg.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

58d5b3f5

update torchao safetensors impl (#30155) · 4b03b502
liangel-02 authored Dec 08, 2025
```
Signed-off-by: Angel Li <liangel@meta.com>
```
4b03b502

[Bugfix] Fix compressed-tensors models failing to load with transformers backend (#30287) · 03b91f72

Michael Goin authored Dec 08, 2025

Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

03b91f72

[Kernel]Support W4A8 Grouped GEMM on Hopper (#29691) · f6227c22
czhu-cohere authored Dec 08, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
f6227c22

[Bugfix] Fix DeepGEMM after #29546 (#30267) · ae339b1a

Zhewen Li authored Dec 08, 2025


Signed-off-by: zhewenli <zhewenli@meta.com>
Signed-off-by: Zhewen Li <zhewenli@meta.com>

ae339b1a