Commits · 560ae9638c00e761d6f1ca33882249dbfebbe8aa · OpenDAS / vllm_cscc

20 Dec, 2025 1 commit
- [XPU] enable fp8 online streaming quantization (#30944) · 560ae963
  Yan Ma authored Dec 20, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  560ae963
19 Dec, 2025 2 commits
- [MoE Refactor][2/N] Use Modular Kernels for Fp8 (#30825) · 95befecc
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  95befecc
- [MoE Refactor][3/N] Deprecate cutlass block quant fp8 (b200) (#30990) · 83a317f6
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  83a317f6
18 Dec, 2025 1 commit
- fix fp8 online quantization streaming with tp > 1 (#30900) · f4ee2c3d
  Vasiliy Kuznetsov authored Dec 18, 2025
```
Signed-off-by: vasiliy <vasiliy@fb.com>
```
  f4ee2c3d
16 Dec, 2025 1 commit
- [Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901) · ce96857f
  Jinzhen Lin authored Dec 17, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ce96857f
15 Dec, 2025 1 commit
- [MoE][Refactor 1/N] Separate Online Quantization (#30627) · d0502b49
  Robert Shaw authored Dec 15, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  d0502b49
13 Dec, 2025 1 commit

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46

Roberto L. Castro authored Dec 13, 2025

Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4fa7ce46

09 Dec, 2025 2 commits

[Quantization] FP8 Weight Reloading for Quantized RL Rollout (#28480) · fccd5325
Kyle Sayers authored Dec 09, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
fccd5325

[MoE][Refactor] Remove most arguments to FusedMoEMethodBase.apply (#29066) · 00e5cbb9

bnellnm authored Dec 09, 2025

Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

00e5cbb9

08 Dec, 2025 1 commit
- online fp8 quant with streaming weight post-processing (#29196) · 0d402d26
  Vasiliy Kuznetsov authored Dec 08, 2025
```
Signed-off-by: vasiliy <vasiliy@fb.com>
```
  0d402d26
04 Dec, 2025 1 commit
- [Bugfix] Fix FP8 MoE LoRA (#29890) · 652ba93d
  Jee Jee Li authored Dec 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  652ba93d
29 Nov, 2025 1 commit

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

27 Nov, 2025 1 commit
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
25 Nov, 2025 1 commit
- [Perf] Disable DeepGEMM MoE by default when TP=8 is used (#29346) · 6f1355a1
  Michael Goin authored Nov 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6f1355a1
24 Nov, 2025 1 commit
- [MoE][Refactor] Make select_experts a non-static method (#29067) · 8f066146
  bnellnm authored Nov 24, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  8f066146
21 Nov, 2025 1 commit

[Log] Optimize startup log (#28948) · a42ab317

Wentao Ye authored Nov 21, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

a42ab317

19 Nov, 2025 1 commit

[Feat][Perf] Enable deepep-low-latency with round-robin expert placement. (#28449) · da2f6800

Chen Bruce authored Nov 19, 2025


Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

da2f6800

14 Nov, 2025 1 commit

[Kernels] Enable FlashInfer FP8 Blockscale on SM90 (for TEP DSR1) (#27134) · 3f8a8740

Duncan Moss authored Nov 14, 2025

Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

3f8a8740

12 Nov, 2025 1 commit

[Performance][B200] Fix deepgemm prologue (#27897) · 74a9a9fa

Varun Sundar Rabindranath authored Nov 12, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

74a9a9fa

11 Nov, 2025 3 commits
- Remove weight_scale.T special case for SM90 Block FP8 CUTLASS kernel (#28431) · f9a40871
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f9a40871
- [Feature] Add env var `VLLM_MOE_USE_DEEP_GEMM` (#28422) · de540c03
  Wentao Ye authored Nov 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  de540c03
- [Feature] Refactor batch invariant fp8 DeepGEMM (#27606) · 35d801f1
  Wentao Ye authored Nov 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  35d801f1
10 Nov, 2025 2 commits

[Performance] Support FP8 flashinfer TRTLLM MOE on Qwen3 and Qwen-3next (#27492) · 34553b9d
jiahanc authored Nov 10, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
34553b9d

[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like... · f080a835

vllmellm authored Nov 10, 2025


[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like `_custom_ops` and `_ipex_ops` (#24490)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f080a835

07 Nov, 2025 1 commit
- [Bugfix] Use latency MOE backend as default for Flashinfer and other misc fixes (#27439) · 72b1c2ae
  Pavani Majety authored Nov 07, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  72b1c2ae
04 Nov, 2025 1 commit
- [Kernels] Isolate modular kernel code from FusedMoEMethodBase subclasses. (#27123) · 938772af
  bnellnm authored Nov 04, 2025
  
  938772af
30 Oct, 2025 1 commit

[Feature] Batch invariant torch.compile (#27660) · e7acb200

Paul Zhang authored Oct 30, 2025


Signed-off-by: PaulZhang12 <paulzhan@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

e7acb200

22 Oct, 2025 1 commit

[Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3

dongbo910220 authored Oct 22, 2025

Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3ae082c3

18 Oct, 2025 1 commit
- [Feature] Batch Invariant: Support DeepGEMM and Blackwell (#27127) · 245e4f2c
  Wentao Ye authored Oct 18, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  245e4f2c
16 Oct, 2025 3 commits

[small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
b2f78cba

Deepseek-v3 Batch Invariant on 8xH100 (#26609) · 7d8975de

Bram Wasti authored Oct 15, 2025


Signed-off-by: Bram Wasti <bwasti@meta.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

7d8975de

[ROCm][FEAT] Fuse DeepSeek shared experts into AITER fused_moe ops (#24097) · 13170343

kliuae authored Oct 16, 2025


Signed-off-by: chenjun <junchen2@amd.com>
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Co-authored-by: valarLip <103567126+valarLip@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

13170343

14 Oct, 2025 1 commit

[torch.compile] Unwrap fused_marlin_moe custom op (#26739) · 8ae16928

Varun Sundar Rabindranath authored Oct 13, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

8ae16928

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- [Model] Apply shared experts overlap optimization to all models with shared experts (#26145) · 47e66c24
  bnellnm authored Oct 09, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  47e66c24
05 Oct, 2025 2 commits
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
- [Bugfix]: Assertion error when using FlashInfer backend (#25933) · 432e1cbc
  Simon Danielsson authored Oct 05, 2025
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  432e1cbc
03 Oct, 2025 1 commit
- [Refactor] Optimize FP8 MOE Backend Choice and Log (#26044) · c1ffcb55
  Wentao Ye authored Oct 03, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c1ffcb55
02 Oct, 2025 1 commit

[Perf] Fix and reapply move apply w8a8 block fp8 linear to class (#25696) · 502640c3

ElizaWszola authored Oct 02, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: ElizaWszola <elizaw.9289@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

502640c3

01 Oct, 2025 1 commit
- [Log] Optimize Log for FP8MOE (#25709) · 12449488
  Wentao Ye authored Sep 30, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  12449488