Commits · cf8eed7bef52293a9a6706a2953374b24dff2c81 · OpenDAS / vllm_cscc

22 Dec, 2025 2 commits
- [Bugfix][ROCm] Fix typo: is_linear_fp8_enaled -> is_linear_fp8_enabled (#31109) · cf8eed7b
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
  cf8eed7b
- [Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN... · 19cc9468
  CedricHuang authored Dec 22, 2025
```
[Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN and FP8_PB_WO  in vLLM (#30957)
```
  19cc9468
21 Dec, 2025 1 commit
- [MoE Refactor][4/N] Marlin Fp8 Mk (#31036) · b471092d
  Robert Shaw authored Dec 21, 2025
  
  b471092d
20 Dec, 2025 4 commits

[Quantization] add marlin w4a8/w8a8 check (#31061) · 7c73ceb5
Jinzhen Lin authored Dec 21, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
```
7c73ceb5

[Quantization] support logical_widths for fp8 marlin (#30962) · ee52d990

Jinzhen Lin authored Dec 21, 2025

Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ee52d990

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891) · 54c89243

baonudesifeizhai authored Dec 20, 2025

Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Signed-off-by: Dongjie Zou <85092850+baonudesifeizhai@users.noreply.github.com>
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

54c89243

[XPU] enable fp8 online streaming quantization (#30944) · 560ae963
Yan Ma authored Dec 20, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
560ae963

19 Dec, 2025 7 commits
- [MoE Refactor][2/N] Use Modular Kernels for Fp8 (#30825) · 95befecc
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  95befecc
- [MoE Refactor][3/N] Deprecate cutlass block quant fp8 (b200) (#30990) · 83a317f6
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  83a317f6
- [Refactor] Refactor for `DeepGemmQuantScaleFMT` using cache (#30898) · 3bd8335b
  Wentao Ye authored Dec 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  3bd8335b
- [Model] Add MiMo-V2-Flash support (#30836) · 969bbc7c
  Zhonghua Deng authored Dec 20, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
Signed-off-by: Jumiar <liuanqim10@126.com>
Signed-off-by: Zyann7 <zyann7@outlook.com>
Co-authored-by: Jumiar <liuanqim10@126.com>
Co-authored-by: Zyann7 <zyann7@outlook.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  969bbc7c
- [Quantization] fix marlin w8a8 check (#30961) · 5fbfa8d9
  Jinzhen Lin authored Dec 19, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
```
  5fbfa8d9
- [Quantization] enable compressed-tensors marlin support for turing (2) (#31008) · 9187de9f
  Jinzhen Lin authored Dec 19, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
```
  9187de9f
- [Quantization] enable compressed-tensors marlin support for turing (#31000) · de08b8f6
  Jinzhen Lin authored Dec 19, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
```
  de08b8f6
18 Dec, 2025 4 commits
- [Bug] Fix compressed tensor not using deepgemm (#30820) · 97000a2b
  Wentao Ye authored Dec 18, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  97000a2b
- fix fp8 online quantization streaming with tp > 1 (#30900) · f4ee2c3d
  Vasiliy Kuznetsov authored Dec 18, 2025
```
Signed-off-by: vasiliy <vasiliy@fb.com>
```
  f4ee2c3d
- [LoRA] Set default MXFP4 LoRA backend to Marlin (#30598) · 9a5e9652
  Xin Yang authored Dec 18, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  9a5e9652
- [Quantization] Support Quark int4-fp8 w4a8 for MoE (#30071) · 0c738b58
  Bowen Bao authored Dec 17, 2025
```
Signed-off-by: Bowen Bao <bowenbao@amd.com>
```
  0c738b58
17 Dec, 2025 2 commits
- [Bug] Fix AttributeError: 'ColumnParallelLinear' object has no attribute... · f284d7bd
  Wentao Ye authored Dec 17, 2025
```
[Bug] Fix AttributeError: 'ColumnParallelLinear' object has no attribute `weight_scale_inv` (#30823)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f284d7bd
- [XPU] fix broken fp8 online quantization for XPU platform (#30831) · 4f735bab
  Yan Ma authored Dec 17, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  4f735bab
16 Dec, 2025 4 commits
- [Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901) · ce96857f
  Jinzhen Lin authored Dec 17, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ce96857f
- [Perf] Do FP4 quant before All gather on flashinfer trtllmgen MOE (#30014) · 254a7f8f
  jiahanc authored Dec 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  254a7f8f
- [CI] Generalize gsm8k test args and add Qwen3-Next MTP B200 test (#30723) · 10ee1c64
  Michael Goin authored Dec 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  10ee1c64
- [TRTLLM] Remove the MoE GEMM weight name change (#30713) · ce12b407
  Ming Yang authored Dec 16, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  ce12b407
15 Dec, 2025 2 commits

[MoE][Refactor 1/N] Separate Online Quantization (#30627) · d0502b49
Robert Shaw authored Dec 15, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
d0502b49

[Feat] Refactor for `parallel_config` in `FusedMoEModularKernel` (#30282) · 3778673e

Wentao Ye authored Dec 14, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

3778673e

14 Dec, 2025 3 commits

[Bugfix] fix _get_quant_method of FusedMoE for deepseekV3.2 on non-NV… (#30057) · 6ecc1e41
tjp_zju authored Dec 14, 2025
```
Signed-off-by: tjp_zju <tanjianpingzju1990@gmail.com>
```
6ecc1e41

Nvidia ModelOpt workaround for issue 28072 (#30164) · 0bb0bae4

Shengliang Xu authored Dec 14, 2025


Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>

0bb0bae4

[Doc]: fixing typos in various files (#30540) · 1a55cfaf

Didier Durand authored Dec 14, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

1a55cfaf

13 Dec, 2025 1 commit

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46

Roberto L. Castro authored Dec 13, 2025

Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4fa7ce46

12 Dec, 2025 7 commits

[CI/Build][Kernel][BugFix][AMD] Fix per_token_group_quant_fp8 to use correct... · 08f8a562

rasmith authored Dec 12, 2025


[CI/Build][Kernel][BugFix][AMD] Fix per_token_group_quant_fp8 to use correct fp8 min/max values and update atol/rtol in test_quantfp8_group_functionality  (#30292)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

08f8a562

[MoE-FP8-modelopt] Add FlashInfer alignment padding for intermediate dimensions (#29748) · 13618626

danielafrimi authored Dec 12, 2025


Signed-off-by: Daniel Afrimi <dafrimi@pool0-00589.cm.cluster>
Signed-off-by: dafrimi <dafrimi@nvidia.com>
Co-authored-by: Daniel Afrimi <dafrimi@pool0-00589.cm.cluster>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

13618626

[Perf] Set split_k to 1 for triton_kernels (#30528) · 1f19d8f8
Xin Yang authored Dec 12, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
1f19d8f8
[ROCm] Enable Triton ScaledMM fallback + kernel selection fix (#26668) · cd7740ac
shivampr authored Dec 12, 2025
```
Signed-off-by: Shivam <shivampr.dev@gmail.com>
Signed-off-by: Shivam <shivamprasad91@gmail.com>
```
cd7740ac

fix(gguf): Disable bfloat16 for GGUF on blackwell device (#30408) · dc13c99e

Christina Norman authored Dec 12, 2025


Signed-off-by: Christina <truffle@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Christina Norman <christina@example.com>
Co-authored-by: Isotr0py <isotr0py@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

dc13c99e

gptq marlin quantization support for fused moe with lora (#30254) · 6a6fc41c
Bhanu Prakash Voutharoja authored Dec 12, 2025
```
Signed-off-by: Bhanu068 <voutharoja.bhanu06@gmail.com>
```
6a6fc41c
[fix] fix SM check for Flashinfer TRTLLM MOE (#30314) · 0ab23c2b
jiahanc authored Dec 11, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
0ab23c2b

11 Dec, 2025 2 commits
- [EPLB] Support EPLB w/ NVFP4 (#29804) · a00d8897
  Andrew Briand authored Dec 11, 2025
```
Signed-off-by: Andrew Briand <abriand@nvidia.com>
Co-authored-by: Andrew Briand <abriand@nvidia.com>
```
  a00d8897
- [Feature] AWQ marlin quantization support for fused moe with lora (#30442) · 0e71eaa6
  汪志鹏 authored Dec 12, 2025
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  0e71eaa6
10 Dec, 2025 1 commit

Fix typos in comments across multiple files (#30345) · 3bdd4266

Wilson Wu authored Dec 10, 2025


Signed-off-by: Wilson Wu <iwilsonwu@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

3bdd4266