Commits · 31021d81a509439c08d5ab17cc38e9c22afc23d7 · OpenDAS / vllm_cscc

26 Nov, 2025 1 commit
- Fix blaslt miss bias · 09c2856a
  zhuwenwen authored Nov 26, 2025
  
  09c2856a
20 Nov, 2025 1 commit
- update m // 8 · cf975626
  zhuwenwen authored Nov 20, 2025
  
  cf975626
13 Nov, 2025 3 commits
- Support blaslt w8a8 GEMM op. · 671dcfff
  zhuwenwen authored Nov 13, 2025
  
  671dcfff
- 解决w8a8 pp16开启marlin的oom问题 · 5bd9b304
  zhuwenwen authored Nov 13, 2025
  
  5bd9b304
- feat: w8a8_marlin 接入，通过-q slimquant_marlin开启，优化w4a8_marlin代码 · f2bac431
  zhuwenwen authored Nov 13, 2025
  
  f2bac431
30 Oct, 2025 1 commit
- skip lmslim import when infer non quantized models · 8e22ded2
  zhuwenwen authored Oct 30, 2025
  
  8e22ded2
22 Oct, 2025 1 commit
- remove redundant routed_scaling_factor · 39380c86
  zhuwenwen authored Oct 22, 2025
  
  39380c86
01 Oct, 2025 1 commit

[Bug] Fix Weight Loading for Block FP8 Cutlass SM90 (#25909) · 9471879b

Wentao Ye authored Sep 29, 2025

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

9471879b

30 Sep, 2025 1 commit
- DeepSeek-R1-Channel-INT8调用rmsquant融合 · 9f087f8b
  zhuwenwen authored Sep 30, 2025
  
  9f087f8b
26 Sep, 2025 3 commits
- [Quantization] Add field to skip unquantized modules for GPTQ config (#25455) · d4d98998
  Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d4d98998
- Llamas 3.1 405B fp4 changes upstreaming from 355_wip (#25135) · 53a30845
  Aleksandr Malyshev authored Sep 25, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
```
  53a30845
- [Refactor] Remove DeepGEMM OP Register (#25710) · 9fe4c2bd
  Wentao Ye authored Sep 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  9fe4c2bd
25 Sep, 2025 4 commits
- Fix routing_bias dtype (#25711) · 081b5594
  Shu Wang authored Sep 25, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  081b5594
- Revert "[Performance] Move apply_w8a8_block_fp8_linear to an op class… (#25607) · 1260180c
  Tyler Michael Smith authored Sep 25, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  1260180c
- [Model] Add LongCat-Flash (#23991) · 845adb3e
  XuruiYang authored Sep 25, 2025
```
Signed-off-by: yangxurui <yangxurui@meituan.com>
Co-authored-by: yangxurui <yangxurui@meituan.com>
```
  845adb3e
- Enable Fbgemm NVFP4 on Dense models (#25609) · 90b139cf
  Saman A. Pour authored Sep 24, 2025
```
Signed-off-by: Saman Keon <samanamp@outlook.com>
```
  90b139cf
24 Sep, 2025 4 commits

[Refactor] Use DeepGEMM Col Major TMA Aligned Tensor (#25517) · 1f291412
Wentao Ye authored Sep 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1f291412

Support mnnvl all2allv from Flashinfer (#21003) · 54e42b72

Shu Wang authored Sep 24, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

54e42b72

[Bugfix][CPU] Skip unsupported custom op register on CPU (#25534) · 1cbcfb94
Li, Jiang authored Sep 24, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
1cbcfb94
[fix]: add Arm 4bit fused moe support (#23809) · 359d2930
Nikhil Gupta authored Sep 24, 2025
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
359d2930

23 Sep, 2025 8 commits

[ROCm] Small functional changes for gptoss (#25201) · bde2a1a8
Juan Villamizar authored Sep 23, 2025
```
Signed-off-by: jpvillam <jpvillam@amd.com>
Co-authored-by: jpvillam <jpvillam@amd.com>
```
bde2a1a8
Remove redundant mutates_args and dispatch_key for direct_register_custom_op (#25512) · 7361ab37
Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
7361ab37

[Performance] Move apply_w8a8_block_fp8_linear to an op class (#24666) · 63400259

ElizaWszola authored Sep 23, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

63400259

[ROCm] Add skinny gemm bias support for dtypes fp16,bf16,fp8 (#24988) · a3a78280

Hashem Hashemi authored Sep 23, 2025


Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
Signed-off-by: Hashem Hashemi <159079214+amd-hhashemi@users.noreply.github.com>

a3a78280

[Kernels] Support blocked fp8 quantization for compressed tensors MoE (#25219) · f11e3c51
bnellnm authored Sep 23, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
f11e3c51
修复W4A8 PP8崩溃问题 · d70425b2
zhuwenwen authored Sep 23, 2025

d70425b2
deepseek-r1-w4a8 mlp/moe调用silu-mul-quant融合 · 3155bf9e
zhuwenwen authored Sep 23, 2025

3155bf9e
[DP/EP][GPTOSS] Use triton matmul-ogs kernels for GPTOSS DP/EP (#24588) · e8db44f8
Varun Sundar Rabindranath authored Sep 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
e8db44f8

19 Sep, 2025 4 commits

Enable modelopt gemma3 nvfp4/fp8, make workflow more robust (#22771) · 431535b5

Zhiyu authored Sep 19, 2025


Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

431535b5

Fix: Correct FusedMoE layer reference in auto_round quantization (#24818) · ddc90483

David-Wen authored Sep 20, 2025

Signed-off-by: David-Wen <18927700430@163.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ddc90483

[Bugfix] GPT OSS Attritbute error on H100 (#25228) · 7852b82b

Varun Sundar Rabindranath authored Sep 19, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

7852b82b

[Docs] add __init__.py to... · 138f0d1e

samzong authored Sep 20, 2025


[Docs] add __init__.py to vllm/model_executor/layers/quantization/compressed_tensors/transform (#24974)
Signed-off-by: samzong <samzong.lu@gmail.com>

138f0d1e

18 Sep, 2025 2 commits
- Refactor dense FP8 tensor/channel/block utils and add CT FP8 block (#21404) · fbd6523a
  Michael Goin authored Sep 18, 2025
  
  fbd6523a
- [Model] Add LongCat-Flash · 50281e36
  zhuwenwen authored Sep 18, 2025
  
  50281e36
17 Sep, 2025 3 commits

[Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses (#22537) · 5963b98b
bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
5963b98b
[Rocm] [quantization] Fix quark ptpc moe and add test case (#24649) · ca2d1925
haoyangli-amd authored Sep 17, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
Co-authored-by: Haoyang Li <haoyang.li@amd.com>
```
ca2d1925

[FP8] Extend per-token-group quantization support to QuantFP8 (#24342) · cef32104

Tahsin Tunan authored Sep 17, 2025

Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

cef32104

16 Sep, 2025 3 commits

[Perf] Reuse workspace for FP8+FP4 Marlin MoE (#20500) · dbebb7f8

Michael Goin authored Sep 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dbebb7f8

fp8 kv cache support fix for torch.compile (#22758) · 3053a22b

Aleksandr Malyshev authored Sep 16, 2025

Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

3053a22b

[ROCm][Bugfix] Fix the case where there's bias (#24895) · 2891603e
Gregory Shtrasberg authored Sep 15, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
2891603e