Commits · 081b5594a2b1a37ea793659bb6767c497beef45d · OpenDAS / vllm_cscc

25 Sep, 2025 4 commits
- Fix routing_bias dtype (#25711) · 081b5594
  Shu Wang authored Sep 25, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  081b5594
- Revert "[Performance] Move apply_w8a8_block_fp8_linear to an op class… (#25607) · 1260180c
  Tyler Michael Smith authored Sep 25, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  1260180c
- [Model] Add LongCat-Flash (#23991) · 845adb3e
  XuruiYang authored Sep 25, 2025
```
Signed-off-by: yangxurui <yangxurui@meituan.com>
Co-authored-by: yangxurui <yangxurui@meituan.com>
```
  845adb3e
- Enable Fbgemm NVFP4 on Dense models (#25609) · 90b139cf
  Saman A. Pour authored Sep 24, 2025
```
Signed-off-by: Saman Keon <samanamp@outlook.com>
```
  90b139cf
24 Sep, 2025 4 commits

[Refactor] Use DeepGEMM Col Major TMA Aligned Tensor (#25517) · 1f291412
Wentao Ye authored Sep 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1f291412

Support mnnvl all2allv from Flashinfer (#21003) · 54e42b72

Shu Wang authored Sep 24, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

54e42b72

[Bugfix][CPU] Skip unsupported custom op register on CPU (#25534) · 1cbcfb94
Li, Jiang authored Sep 24, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
1cbcfb94
[fix]: add Arm 4bit fused moe support (#23809) · 359d2930
Nikhil Gupta authored Sep 24, 2025
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
359d2930

23 Sep, 2025 6 commits

[ROCm] Small functional changes for gptoss (#25201) · bde2a1a8
Juan Villamizar authored Sep 23, 2025
```
Signed-off-by: jpvillam <jpvillam@amd.com>
Co-authored-by: jpvillam <jpvillam@amd.com>
```
bde2a1a8
Remove redundant mutates_args and dispatch_key for direct_register_custom_op (#25512) · 7361ab37
Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
7361ab37

[Performance] Move apply_w8a8_block_fp8_linear to an op class (#24666) · 63400259

ElizaWszola authored Sep 23, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

63400259

[ROCm] Add skinny gemm bias support for dtypes fp16,bf16,fp8 (#24988) · a3a78280

Hashem Hashemi authored Sep 23, 2025


Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
Signed-off-by: Hashem Hashemi <159079214+amd-hhashemi@users.noreply.github.com>

a3a78280

[Kernels] Support blocked fp8 quantization for compressed tensors MoE (#25219) · f11e3c51
bnellnm authored Sep 23, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
f11e3c51
[DP/EP][GPTOSS] Use triton matmul-ogs kernels for GPTOSS DP/EP (#24588) · e8db44f8
Varun Sundar Rabindranath authored Sep 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
e8db44f8

19 Sep, 2025 4 commits

Enable modelopt gemma3 nvfp4/fp8, make workflow more robust (#22771) · 431535b5

Zhiyu authored Sep 19, 2025


Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

431535b5

Fix: Correct FusedMoE layer reference in auto_round quantization (#24818) · ddc90483

David-Wen authored Sep 20, 2025

Signed-off-by: David-Wen <18927700430@163.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ddc90483

[Bugfix] GPT OSS Attritbute error on H100 (#25228) · 7852b82b

Varun Sundar Rabindranath authored Sep 19, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

7852b82b

[Docs] add __init__.py to... · 138f0d1e

samzong authored Sep 20, 2025


[Docs] add __init__.py to vllm/model_executor/layers/quantization/compressed_tensors/transform (#24974)
Signed-off-by: samzong <samzong.lu@gmail.com>

138f0d1e

18 Sep, 2025 1 commit
- Refactor dense FP8 tensor/channel/block utils and add CT FP8 block (#21404) · fbd6523a
  Michael Goin authored Sep 18, 2025
  
  fbd6523a
17 Sep, 2025 3 commits

[Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses (#22537) · 5963b98b
bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
5963b98b
[Rocm] [quantization] Fix quark ptpc moe and add test case (#24649) · ca2d1925
haoyangli-amd authored Sep 17, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
Co-authored-by: Haoyang Li <haoyang.li@amd.com>
```
ca2d1925

[FP8] Extend per-token-group quantization support to QuantFP8 (#24342) · cef32104

Tahsin Tunan authored Sep 17, 2025

Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

cef32104

16 Sep, 2025 3 commits

[Perf] Reuse workspace for FP8+FP4 Marlin MoE (#20500) · dbebb7f8

Michael Goin authored Sep 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dbebb7f8

fp8 kv cache support fix for torch.compile (#22758) · 3053a22b

Aleksandr Malyshev authored Sep 16, 2025

Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

3053a22b

[ROCm][Bugfix] Fix the case where there's bias (#24895) · 2891603e
Gregory Shtrasberg authored Sep 15, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
2891603e

15 Sep, 2025 2 commits
- [Transform] Deterministic Hadacore Transforms (#24106) · a0b26701
  Kyle Sayers authored Sep 15, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  a0b26701
- [Doc]: fix typos in various files (#24821) · 4979eb79
  Didier Durand authored Sep 15, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  4979eb79
14 Sep, 2025 1 commit

[Perf] Fix DeepGEMM Contiguous Layout Issue, 5.5% Throughput Improvement (#24783) · fc2dbcda

Wentao Ye authored Sep 14, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

fc2dbcda

12 Sep, 2025 2 commits
- [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705) · 7ba32aa6
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  7ba32aa6
- [Docs] Fix warnings in mkdocs build (continued) (#24740) · 41f17bf2
  Hyogeun Oh (오효근) authored Sep 12, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  41f17bf2
11 Sep, 2025 5 commits

[Bug] Fix Layer `weight_block_size` Assertion Issue (#24674) · fcba05c4
Wentao Ye authored Sep 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
fcba05c4

[Perf] Use upstream CUTLASS for SM90 Block FP8 kernel (#23280) · c3aea10d

Michael Goin authored Sep 11, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

c3aea10d

[Kernel][B200] `mxfp4` fused cutlass moe (#23696) · 074854b2

Duncan Moss authored Sep 11, 2025


Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

074854b2

[Doc] Remove Useless Comments (#24687) · a892b259
Wentao Ye authored Sep 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
a892b259
[torchao] Support quantization configs using module swap (#21982) · 2048c4e3
Jerry Zhang authored Sep 10, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
2048c4e3

10 Sep, 2025 5 commits

[torch.compile][ROCm][V1] Enable attention output FP8 fusion for V1 attention backends (#19767) · 9a161307

Gregory Shtrasberg authored Sep 10, 2025


Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

9a161307

[Bugfix] fix modelopt exclude_modules name mapping (#24178) · 08abfa78

tomeras91 authored Sep 10, 2025


Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

08abfa78

[Docs] Fix warnings in `mkdocs build` (continued) (#24092) · ccee371e

Hyogeun Oh (오효근) authored Sep 10, 2025

Signed-off-by: Zerohertz <ohg3417@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

ccee371e

Fix Auto_Round Quatization Loading on SM75 and Lower GPUs (#24217) · c0bd6a68

RoadToNowhereX authored Sep 10, 2025


Signed-off-by: RoadToNowhereX <37441177+RoadToNowhereX@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

c0bd6a68

[gpt-oss] Cache permute indices for faster MXFP4 MoE layer loading (#24154) · 0efdb5c3
Wei authored Sep 09, 2025
```
Signed-off-by: Wei Wei <wwei6@meta.com>
```
0efdb5c3