Commits · a26917332fabf5fee6544f2215e211f59d27a774 · OpenDAS / vllm_cscc

"tests/models/embedding/language/test_embedding.py" did not exist on "c96fc067479453b02e92d9378eeeaebb6b3816de"

03 Oct, 2025 2 commits
- [Quantization/NVFP4] Speed up TRTLLM NVFP4 MOE weight loading and fix K/V... · a2691733
  Pavani Majety authored Oct 03, 2025
```
[Quantization/NVFP4] Speed up TRTLLM NVFP4 MOE weight loading and fix K/V scale loading for MLA Attn (#25968)
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  a2691733
- [Bugfix] Fix import `gemm_afp4wfp4` failure on AMD (#26068) · 711f4856
  Zhewen Li authored Oct 02, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  711f4856
02 Oct, 2025 1 commit

[Perf] Fix and reapply move apply w8a8 block fp8 linear to class (#25696) · 502640c3

ElizaWszola authored Oct 02, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

502640c3

01 Oct, 2025 2 commits
- Support RL online quantization with torchao (#23014) · c3124680
  Jerry Zhang authored Oct 01, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  c3124680
- [Log] Optimize Log for FP8MOE (#25709) · 12449488
  Wentao Ye authored Sep 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  12449488
30 Sep, 2025 4 commits
- [Bug] Fix AttributeError: 'QKVParallelLinear' object has no attribute 'orig_dtype' (#25958) · e6a226ef
  Wentao Ye authored Sep 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e6a226ef
- [Bugfix] Fix accuracy issue of TRTLLM FP8 MOE and improve logging (#25895) · ef283548
  Pavani Majety authored Sep 30, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  ef283548
- Move`VllmConfig` from `config/__init__.py` to `config/vllm.py` (#25271) · 61aedb5f
  Harry Mellor authored Sep 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  61aedb5f
- [Bug] Fix Weight Loading for Block FP8 Cutlass SM90 (#25909) · 89e4050a
  Wentao Ye authored Sep 29, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  89e4050a
29 Sep, 2025 1 commit
- [Bugfix] Use correct key "ignore" for config.json non-quantized layers (#25706) · d5ab2851
  Lee Nau authored Sep 29, 2025
```
Signed-off-by: Lee Nau <lnau@nvidia.com>
```
  d5ab2851
26 Sep, 2025 3 commits
- [Quantization] Add field to skip unquantized modules for GPTQ config (#25455) · d4d98998
  Isotr0py authored Sep 26, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d4d98998
- Llamas 3.1 405B fp4 changes upstreaming from 355_wip (#25135) · 53a30845
  Aleksandr Malyshev authored Sep 25, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
```
  53a30845
- [Refactor] Remove DeepGEMM OP Register (#25710) · 9fe4c2bd
  Wentao Ye authored Sep 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  9fe4c2bd
25 Sep, 2025 4 commits
- Fix routing_bias dtype (#25711) · 081b5594
  Shu Wang authored Sep 25, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  081b5594
- Revert "[Performance] Move apply_w8a8_block_fp8_linear to an op class… (#25607) · 1260180c
  Tyler Michael Smith authored Sep 25, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  1260180c
- [Model] Add LongCat-Flash (#23991) · 845adb3e
  XuruiYang authored Sep 25, 2025
```
Signed-off-by: yangxurui <yangxurui@meituan.com>
Co-authored-by: yangxurui <yangxurui@meituan.com>
```
  845adb3e
- Enable Fbgemm NVFP4 on Dense models (#25609) · 90b139cf
  Saman A. Pour authored Sep 24, 2025
```
Signed-off-by: Saman Keon <samanamp@outlook.com>
```
  90b139cf
24 Sep, 2025 4 commits

[Refactor] Use DeepGEMM Col Major TMA Aligned Tensor (#25517) · 1f291412
Wentao Ye authored Sep 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1f291412

Support mnnvl all2allv from Flashinfer (#21003) · 54e42b72

Shu Wang authored Sep 24, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

54e42b72

[Bugfix][CPU] Skip unsupported custom op register on CPU (#25534) · 1cbcfb94
Li, Jiang authored Sep 24, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
1cbcfb94
[fix]: add Arm 4bit fused moe support (#23809) · 359d2930
Nikhil Gupta authored Sep 24, 2025
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
359d2930

23 Sep, 2025 6 commits

[ROCm] Small functional changes for gptoss (#25201) · bde2a1a8
Juan Villamizar authored Sep 23, 2025
```
Signed-off-by: jpvillam <jpvillam@amd.com>
Co-authored-by: jpvillam <jpvillam@amd.com>
```
bde2a1a8
Remove redundant mutates_args and dispatch_key for direct_register_custom_op (#25512) · 7361ab37
Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
7361ab37

[Performance] Move apply_w8a8_block_fp8_linear to an op class (#24666) · 63400259

ElizaWszola authored Sep 23, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

63400259

[ROCm] Add skinny gemm bias support for dtypes fp16,bf16,fp8 (#24988) · a3a78280

Hashem Hashemi authored Sep 23, 2025


Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
Signed-off-by: Hashem Hashemi <159079214+amd-hhashemi@users.noreply.github.com>

a3a78280

[Kernels] Support blocked fp8 quantization for compressed tensors MoE (#25219) · f11e3c51
bnellnm authored Sep 23, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
f11e3c51
[DP/EP][GPTOSS] Use triton matmul-ogs kernels for GPTOSS DP/EP (#24588) · e8db44f8
Varun Sundar Rabindranath authored Sep 23, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
e8db44f8

19 Sep, 2025 4 commits

Enable modelopt gemma3 nvfp4/fp8, make workflow more robust (#22771) · 431535b5

Zhiyu authored Sep 19, 2025


Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

431535b5

Fix: Correct FusedMoE layer reference in auto_round quantization (#24818) · ddc90483

David-Wen authored Sep 20, 2025

Signed-off-by: David-Wen <18927700430@163.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ddc90483

[Bugfix] GPT OSS Attritbute error on H100 (#25228) · 7852b82b

Varun Sundar Rabindranath authored Sep 19, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

7852b82b

[Docs] add __init__.py to... · 138f0d1e

samzong authored Sep 20, 2025


[Docs] add __init__.py to vllm/model_executor/layers/quantization/compressed_tensors/transform (#24974)
Signed-off-by: samzong <samzong.lu@gmail.com>

138f0d1e

18 Sep, 2025 1 commit
- Refactor dense FP8 tensor/channel/block utils and add CT FP8 block (#21404) · fbd6523a
  Michael Goin authored Sep 18, 2025
  
  fbd6523a
17 Sep, 2025 3 commits

[Kernel] Delegate construction of FusedMoEQuantConfig to FusedMoEMethodBase subclasses (#22537) · 5963b98b
bnellnm authored Sep 17, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
5963b98b
[Rocm] [quantization] Fix quark ptpc moe and add test case (#24649) · ca2d1925
haoyangli-amd authored Sep 17, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
Co-authored-by: Haoyang Li <haoyang.li@amd.com>
```
ca2d1925

[FP8] Extend per-token-group quantization support to QuantFP8 (#24342) · cef32104

Tahsin Tunan authored Sep 17, 2025

Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

cef32104

16 Sep, 2025 3 commits

[Perf] Reuse workspace for FP8+FP4 Marlin MoE (#20500) · dbebb7f8

Michael Goin authored Sep 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dbebb7f8

fp8 kv cache support fix for torch.compile (#22758) · 3053a22b

Aleksandr Malyshev authored Sep 16, 2025

Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

3053a22b

[ROCm][Bugfix] Fix the case where there's bias (#24895) · 2891603e
Gregory Shtrasberg authored Sep 15, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
2891603e

15 Sep, 2025 2 commits
- [Transform] Deterministic Hadacore Transforms (#24106) · a0b26701
  Kyle Sayers authored Sep 15, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  a0b26701
- [Doc]: fix typos in various files (#24821) · 4979eb79
  Didier Durand authored Sep 15, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  4979eb79