Commits · c598039921b958db15fdc1ba5455bb6917d33a24 · OpenDAS / vllm_cscc

21 Jan, 2026 2 commits
- feat: Supprot fp8 channle-wise matmul. · 94c8a620
  wanglong3 authored Jan 21, 2026
  
  94c8a620
- feat: support fp8-blockwise matmul impl. · 96590097
  lixh6 authored Jan 20, 2026
  
  96590097
14 Jan, 2026 2 commits
- 适配block-wise fp8接口 · 284b2450
  SAC_fanth authored Jan 14, 2026
  
  284b2450
- Switch default w8a8 gemm impl to blaslt. · 80e71eb8
  wanglong3 authored Jan 14, 2026
  
  80e71eb8
07 Jan, 2026 1 commit
- remove USE_FUSED_RMS_QUANT and USE_FUSED_SILU_MUL_QUANT · c2ef7fdd
  zhuwenwen authored Jan 07, 2026
  
  c2ef7fdd
05 Jan, 2026 1 commit
- fix: 修复deepseek量化模型的若干问题 · d10b80ce
  jujl1 authored Jan 05, 2026
  
  d10b80ce
24 Dec, 2025 1 commit
- 在v0.11中暂不支持awq的scale和zero合并操作 · 0ba1219a
  yangql authored Dec 24, 2025
  
  0ba1219a
23 Dec, 2025 1 commit
- 适配gptq/awq的triton moe算子 · 25e8b412
  yangql authored Dec 23, 2025
  
  25e8b412
17 Dec, 2025 1 commit
- 修复CompressedTensorsLinearMethod中的w4a16的冲突问题 · 37771741
  chenyue3 authored Dec 17, 2025
  
  37771741
26 Nov, 2025 1 commit
- Fix blaslt miss bias · 09c2856a
  zhuwenwen authored Nov 26, 2025
  
  09c2856a
20 Nov, 2025 1 commit
- update m // 8 · cf975626
  zhuwenwen authored Nov 20, 2025
  
  cf975626
13 Nov, 2025 3 commits
- Support blaslt w8a8 GEMM op. · 671dcfff
  zhuwenwen authored Nov 13, 2025
  
  671dcfff
- 解决w8a8 pp16开启marlin的oom问题 · 5bd9b304
  zhuwenwen authored Nov 13, 2025
  
  5bd9b304
- feat: w8a8_marlin 接入，通过-q slimquant_marlin开启，优化w4a8_marlin代码 · f2bac431
  zhuwenwen authored Nov 13, 2025
  
  f2bac431
30 Oct, 2025 1 commit
- skip lmslim import when infer non quantized models · 8e22ded2
  zhuwenwen authored Oct 30, 2025
  
  8e22ded2
22 Oct, 2025 1 commit
- remove redundant routed_scaling_factor · 39380c86
  zhuwenwen authored Oct 22, 2025
  
  39380c86
01 Oct, 2025 1 commit

[Bug] Fix Weight Loading for Block FP8 Cutlass SM90 (#25909) · 9471879b

Wentao Ye authored Sep 29, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

9471879b

30 Sep, 2025 1 commit
- DeepSeek-R1-Channel-INT8调用rmsquant融合 · 9f087f8b
  zhuwenwen authored Sep 30, 2025
  
  9f087f8b
26 Sep, 2025 3 commits
- [Quantization] Add field to skip unquantized modules for GPTQ config (#25455) · d4d98998
  Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d4d98998
- Llamas 3.1 405B fp4 changes upstreaming from 355_wip (#25135) · 53a30845
  Aleksandr Malyshev authored Sep 25, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
```
  53a30845
- [Refactor] Remove DeepGEMM OP Register (#25710) · 9fe4c2bd
  Wentao Ye authored Sep 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  9fe4c2bd
25 Sep, 2025 4 commits
- Fix routing_bias dtype (#25711) · 081b5594
  Shu Wang authored Sep 25, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  081b5594
- Revert "[Performance] Move apply_w8a8_block_fp8_linear to an op class… (#25607) · 1260180c
  Tyler Michael Smith authored Sep 25, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  1260180c
- [Model] Add LongCat-Flash (#23991) · 845adb3e
  XuruiYang authored Sep 25, 2025
```
Signed-off-by: yangxurui <yangxurui@meituan.com>
Co-authored-by: yangxurui <yangxurui@meituan.com>
```
  845adb3e
- Enable Fbgemm NVFP4 on Dense models (#25609) · 90b139cf
  Saman A. Pour authored Sep 24, 2025
```
Signed-off-by: Saman Keon <samanamp@outlook.com>
```
  90b139cf
24 Sep, 2025 4 commits

[Refactor] Use DeepGEMM Col Major TMA Aligned Tensor (#25517) · 1f291412
Wentao Ye authored Sep 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1f291412

Support mnnvl all2allv from Flashinfer (#21003) · 54e42b72

Shu Wang authored Sep 24, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

54e42b72

[Bugfix][CPU] Skip unsupported custom op register on CPU (#25534) · 1cbcfb94
Li, Jiang authored Sep 24, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
1cbcfb94
[fix]: add Arm 4bit fused moe support (#23809) · 359d2930
Nikhil Gupta authored Sep 24, 2025
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
359d2930

23 Sep, 2025 8 commits

[ROCm] Small functional changes for gptoss (#25201) · bde2a1a8
Juan Villamizar authored Sep 23, 2025
```
Signed-off-by: jpvillam <jpvillam@amd.com>
Co-authored-by: jpvillam <jpvillam@amd.com>
```
bde2a1a8
Remove redundant mutates_args and dispatch_key for direct_register_custom_op (#25512) · 7361ab37
Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
7361ab37

[Performance] Move apply_w8a8_block_fp8_linear to an op class (#24666) · 63400259

ElizaWszola authored Sep 23, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

63400259

[ROCm] Add skinny gemm bias support for dtypes fp16,bf16,fp8 (#24988) · a3a78280

Hashem Hashemi authored Sep 23, 2025


Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
Signed-off-by: Hashem Hashemi <159079214+amd-hhashemi@users.noreply.github.com>

a3a78280

[Kernels] Support blocked fp8 quantization for compressed tensors MoE (#25219) · f11e3c51
bnellnm authored Sep 23, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
f11e3c51
修复W4A8 PP8崩溃问题 · d70425b2
zhuwenwen authored Sep 23, 2025

d70425b2
deepseek-r1-w4a8 mlp/moe调用silu-mul-quant融合 · 3155bf9e
zhuwenwen authored Sep 23, 2025

3155bf9e
[DP/EP][GPTOSS] Use triton matmul-ogs kernels for GPTOSS DP/EP (#24588) · e8db44f8
Varun Sundar Rabindranath authored Sep 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
e8db44f8

19 Sep, 2025 3 commits

Enable modelopt gemma3 nvfp4/fp8, make workflow more robust (#22771) · 431535b5

Zhiyu authored Sep 19, 2025


Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

431535b5

Fix: Correct FusedMoE layer reference in auto_round quantization (#24818) · ddc90483

David-Wen authored Sep 20, 2025

Signed-off-by: David-Wen <18927700430@163.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ddc90483

[Bugfix] GPT OSS Attritbute error on H100 (#25228) · 7852b82b

Varun Sundar Rabindranath authored Sep 19, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

7852b82b