Commits · d3e477c01342f800790b170b8fa799b467621358 · OpenDAS / vllm_cscc

06 Jan, 2026 3 commits

[Bugfix] Fix torch.compile error for DP + MoE on CPU Backend (#31650) · bf0f3a46
kzwrime authored Jan 06, 2026
```
Signed-off-by: kunzh <zhikun.wu@outlook.com>
```
bf0f3a46

[Perf] Optimize additional `fill(0)` in cutlass moe, 2.9% E2E throughput... · ffec8154

Wentao Ye authored Jan 05, 2026


[Perf] Optimize additional `fill(0)` in cutlass moe, 2.9% E2E throughput improvement, 10.8% TTFT improvement (#31754)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

ffec8154

[Docs] Improve malformed exception caused by backslash line continuations (#31694) · d386ab14

maang authored Jan 06, 2026


Signed-off-by: maang <maang_h@163.com>
Signed-off-by: maang <55082429+maang-h@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

d386ab14

05 Jan, 2026 4 commits
- [Bugfix] Fix Broken ModelOpt NVFP4 MoE (#31742) · f6c0009a
  Robert Shaw authored Jan 05, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  f6c0009a
- [MoE Refactor] Aiter Experts for BF16 MoE (#31542) · 776ca1e1
  Yongye Zhu authored Jan 05, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  776ca1e1
- [Misc][Model][Refactor] Pass the prefix into Linear layers (#31669) · 5708297e
  Wang Kunpeng authored Jan 06, 2026
```
Signed-off-by: Wang Kunpeng <1289706727@qq.com>
```
  5708297e
- [Bugfix][CPU] Fix RotaryEmbedding fallback causing gibberish with --enforce-eager (#31643) · c455b771
  RickyChen / 陳昭儒 authored Jan 06, 2026
```
Signed-off-by: rickychen-infinirc <ricky.chen@infinirc.com>
```
  c455b771
03 Jan, 2026 1 commit

[MoE Refactor][13/N] Convert FI to Use PFNoEP (#31533) · 268b1c55

Robert Shaw authored Jan 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

268b1c55

02 Jan, 2026 7 commits
- [MoE Refactor] Explicit construct mk for flashinfer bf16 kernel (#31504) · a3f2f409
  Yongye Zhu authored Jan 02, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  a3f2f409
- [MoE Refactor] Split `invoke_fused_moe_kernel` (#31050) · 5a468ff7
  Yongye Zhu authored Jan 02, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  5a468ff7
- [MoE] Fix output_shape calculation in Attention layer to handle 3D query inputs (#31596) · 6ef770df
  Andreas Karatzas authored Jan 02, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  6ef770df
- [Bugfix] Fix weight_loader v1 block scale (#31103) · cc410e86
  Kyuyeun Kim authored Jan 01, 2026
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  cc410e86
- Remove unused `use_marlin` variable in `Mxfp4MoEMethod` (#31549) · 1f43c121
  Vaibhav Sourirajan authored Jan 02, 2026
```
Signed-off-by: vaibhav sourirajan <vs2787@columbia.edu>
```
  1f43c121
- [Bugfix] Fix activation quantization for compressed-tensors W4A16 (#31572) · ca179d0f
  Tmn07 authored Jan 02, 2026
```
Signed-off-by: Tmn07 <tmn0796@gmail.com>
```
  ca179d0f
- [Bugfix] Replace BaseException with specific exceptions in FLA utils (#31590) · 5fff4406
  Kevin McKay authored Jan 01, 2026
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  5fff4406
31 Dec, 2025 1 commit
- [Mics] add pcp basic support to MoE model (#31003) · 84f6cd74
  Qiu authored Dec 31, 2025
  
  84f6cd74
30 Dec, 2025 1 commit
- [BugFix] add select_gemm_impl on CompressedTensorsWNA16MoEMethod to support LoRA (#31453) · 07728bf5
  JartX authored Dec 30, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  07728bf5
29 Dec, 2025 3 commits

[Bugfix][ROCm] Fix Static Quant Issue (#31502) · 56f51625

Robert Shaw authored Dec 29, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

56f51625

[MoE Refactor][12/N] Marlin Fp8 MoE Pure Function (#31499) · 9152a30d
Robert Shaw authored Dec 29, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
9152a30d
Optimize QKNorm for MiniMax-M2/M2.1 (#31493) · 5bc66411
Roger Young authored Dec 30, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
5bc66411

28 Dec, 2025 2 commits
- Add Fused MoE Triton kernels for GLM-4.5-Air, GLM-4.5v, GLM-4.6v on 2x RTX Pro 6000 (#31407) · b9793e6a
  Mamy Ratsimbazafy authored Dec 28, 2025
```
Signed-off-by: Mamy Ratsimbazafy <mamy_github@numforge.co>
```
  b9793e6a
- [Model] Add tuned triton fused_moe configs for Qwen3Moe on B200 (#31448) · 0b6b7010
  Jzz1943 authored Dec 29, 2025
```
Signed-off-by: Zhongze Jiang <jiangzhongze.jzz@ant-intl.com>
```
  0b6b7010
27 Dec, 2025 1 commit
- [MoE Refactor][10/N] Cleanup Fp8 Process Weights After Loading (#31169) · 727c41f3
  Robert Shaw authored Dec 27, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  727c41f3
26 Dec, 2025 1 commit
- CustomOp: Unify aiter impl into GroupedTopk (#31221) · 87f1b8ca
  Xinyu Chen authored Dec 27, 2025
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  87f1b8ca
24 Dec, 2025 2 commits
- [Bugfix] Remove dead `block_quant_to_tensor_quant` function (#31294) · 506eb0f4
  ゆり authored Dec 25, 2025
```
Co-authored-by: yurekami <yurekami@users.noreply.github.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  506eb0f4
- [Bugfix][Hardware][AMD] Fix FP8 dtype in silu_mul quantization (#31179) · 66c98874
  Kevin McKay authored Dec 24, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  66c98874
23 Dec, 2025 2 commits
- [Mamba] - Consolidate Mambas Attention Logic (#28133) · 34916ae3
  Asaf Joseph Gardin authored Dec 23, 2025
  
  34916ae3
- Revert "[SM100] Enable fp8 compute for prefill MLA (#30746)" (#31197) · 3e102623
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  3e102623
22 Dec, 2025 5 commits
- [MoE Refactor][7/N] AITER MK (#31102) · b57b9673
  Robert Shaw authored Dec 22, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  b57b9673
- [SM100] Enable fp8 compute for prefill MLA (#30746) · b10f41c8
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  b10f41c8
- [MoE Refactor][9/N] Use modular kernel for unquantized Triton MoE (#31052) · 7b926e89
  Yongye Zhu authored Dec 22, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  7b926e89
- [Bugfix][ROCm] Fix typo: is_linear_fp8_enaled -> is_linear_fp8_enabled (#31109) · cf8eed7b
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
  cf8eed7b
- [Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN... · 19cc9468
  CedricHuang authored Dec 22, 2025
```
[Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN and FP8_PB_WO  in vLLM (#30957)
```
  19cc9468
21 Dec, 2025 1 commit
- [MoE Refactor][4/N] Marlin Fp8 Mk (#31036) · b471092d
  Robert Shaw authored Dec 21, 2025
  
  b471092d
20 Dec, 2025 4 commits

[Quantization] add marlin w4a8/w8a8 check (#31061) · 7c73ceb5
Jinzhen Lin authored Dec 21, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
```
7c73ceb5

[Quantization] support logical_widths for fp8 marlin (#30962) · ee52d990

Jinzhen Lin authored Dec 21, 2025

Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ee52d990

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891) · 54c89243

baonudesifeizhai authored Dec 20, 2025

Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Signed-off-by: Dongjie Zou <85092850+baonudesifeizhai@users.noreply.github.com>
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

54c89243

[XPU] enable fp8 online streaming quantization (#30944) · 560ae963
Yan Ma authored Dec 20, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
560ae963

19 Dec, 2025 2 commits
- [MoE Refactor][2/N] Use Modular Kernels for Fp8 (#30825) · 95befecc
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  95befecc
- [MoE Refactor][3/N] Deprecate cutlass block quant fp8 (b200) (#30990) · 83a317f6
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  83a317f6