Commits · 5a93b9162bfef6be6714ba70d3191e1e7ab7d3e4 · OpenDAS / vllm_cscc

27 Jan, 2026 1 commit

[MoE Refactor] Integrate Naive Prepare Finalize into MK (#32567) · 5a93b916

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: amirkl94 <203507526+amirkl94@users.noreply.github.com>

5a93b916

26 Jan, 2026 1 commit

[FIX] Always support TP > 4 for FP4 Gemm (#31099) · 67fe677c

danielafrimi authored Jan 26, 2026


Signed-off-by: dafrimi <dafrimi@nvidia.com>
Co-authored-by: root <root@gpu-51.slurm-workers-slurm.slurm.svc.cluster.local>

67fe677c

25 Jan, 2026 1 commit
- [Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
  Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  fcb9df99
22 Jan, 2026 1 commit
- [MoE Refactor] Move `select_experts` from `FusedMoEQuantMethod` -> `FusedMoE` (#31996) · dc917cce
  bnellnm authored Jan 22, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  dc917cce
21 Jan, 2026 1 commit
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68
20 Jan, 2026 1 commit
- [Refactor] Make FP8 Linear Ops use kernel abstraction (#27814) · 148117ea
  vllmellm authored Jan 20, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  148117ea
19 Jan, 2026 1 commit

[BugFix] Fix TRT-LLM NVFP4 DP/EP (#32349) · 73503317

jiahanc authored Jan 19, 2026


Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

73503317

18 Jan, 2026 1 commit
- [MoE Refactor] Separate Router into OO Classes (#30623) · 327a02d8
  bnellnm authored Jan 18, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  327a02d8
16 Jan, 2026 1 commit

[Feat] Support non-gated MoE with Marlin, NVFP4 CUTLASS, FP8, INT8, compressed-tensors (#32257) · c277fbdf

TomerBN-Nvidia authored Jan 16, 2026


Signed-off-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Tomer Natan <tbarnatan@ipp1-1429.ipp1a1.colossus.nvidia.com>

c277fbdf

13 Jan, 2026 1 commit

[Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding (#30885) · 8ef50d9a

Roberto L. Castro authored Jan 14, 2026

Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>

8ef50d9a

08 Jan, 2026 3 commits

[Misc][Refactor] Add FusedMoERouter object (#30519) · e74698c2
bnellnm authored Jan 08, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
e74698c2

[MoE Refactor][16/N] Apply Refactor to NVFP4 (#31692) · 9f6dcb71

Robert Shaw authored Jan 07, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>

9f6dcb71

[MoE Refactor][15/N] Apply Refactor to Fp8 (#31415) · 5dcd7ef1
Robert Shaw authored Jan 07, 2026

5dcd7ef1

06 Jan, 2026 1 commit
- [MoE Refactor][14/N] Clean Up FI Quant Config Smuggling (#31593) · af8fd730
  Robert Shaw authored Jan 06, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  af8fd730
05 Jan, 2026 1 commit

[Bugfix] Fix Broken ModelOpt NVFP4 MoE (#31742) · f6c0009a

Robert Shaw authored Jan 05, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

f6c0009a

03 Jan, 2026 1 commit

[MoE Refactor][13/N] Convert FI to Use PFNoEP (#31533) · 268b1c55

Robert Shaw authored Jan 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

268b1c55

22 Dec, 2025 1 commit
- [Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN... · 19cc9468
  CedricHuang authored Dec 22, 2025
```
[Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN and FP8_PB_WO  in vLLM (#30957)
```
  19cc9468
20 Dec, 2025 1 commit

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891) · 54c89243

baonudesifeizhai authored Dec 20, 2025

Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Signed-off-by: Dongjie Zou <85092850+baonudesifeizhai@users.noreply.github.com>
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

54c89243

16 Dec, 2025 3 commits
- [Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901) · ce96857f
  Jinzhen Lin authored Dec 17, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ce96857f
- [Perf] Do FP4 quant before All gather on flashinfer trtllmgen MOE (#30014) · 254a7f8f
  jiahanc authored Dec 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  254a7f8f
- [TRTLLM] Remove the MoE GEMM weight name change (#30713) · ce12b407
  Ming Yang authored Dec 16, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  ce12b407
14 Dec, 2025 1 commit

Nvidia ModelOpt workaround for issue 28072 (#30164) · 0bb0bae4

Shengliang Xu authored Dec 14, 2025


Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>

0bb0bae4

12 Dec, 2025 1 commit

[MoE-FP8-modelopt] Add FlashInfer alignment padding for intermediate dimensions (#29748) · 13618626

danielafrimi authored Dec 12, 2025


Signed-off-by: Daniel Afrimi <dafrimi@pool0-00589.cm.cluster>
Signed-off-by: dafrimi <dafrimi@nvidia.com>
Co-authored-by: Daniel Afrimi <dafrimi@pool0-00589.cm.cluster>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

13618626

11 Dec, 2025 1 commit

[EPLB] Support EPLB w/ NVFP4 (#29804) · a00d8897

Andrew Briand authored Dec 11, 2025


Signed-off-by: Andrew Briand <abriand@nvidia.com>
Co-authored-by: Andrew Briand <abriand@nvidia.com>

a00d8897

09 Dec, 2025 1 commit

[MoE][Refactor] Remove most arguments to FusedMoEMethodBase.apply (#29066) · 00e5cbb9

bnellnm authored Dec 09, 2025

Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

00e5cbb9

30 Nov, 2025 1 commit
- [Feat] Support non-gated activations in NVFP4 modelopt path (#29004) · 39d28108
  Omer Ullman Argov authored Nov 30, 2025
  
  39d28108
29 Nov, 2025 1 commit

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

27 Nov, 2025 1 commit
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
25 Nov, 2025 1 commit
- [Kernel] Add NVFP4 MoE CUTLASS support for SM120 (#29242) · e5020986
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e5020986
24 Nov, 2025 1 commit
- [MoE][Refactor] Make select_experts a non-static method (#29067) · 8f066146
  bnellnm authored Nov 24, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  8f066146
21 Nov, 2025 1 commit

Add TRTLLM MoE NVFP4 kernel to CompressedTensorsW4A4MoeMethod (#28892) · b4c8fbaa

Mingyuan Ma authored Nov 21, 2025


Signed-off-by: mingyuanm <mingyuanm@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

b4c8fbaa

20 Nov, 2025 1 commit
- Consolidate Nvidia ModelOpt quant config handling for all quantization methods (#28076) · a8c53682
  Shengliang Xu authored Nov 19, 2025
```
Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>
```
  a8c53682
19 Nov, 2025 3 commits
- [Refactor] Optimize `select_experts` (#28069) · 5031cd5d
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5031cd5d
- [MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990) · 613abb50
  Shu Wang authored Nov 19, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  613abb50
- [Feat][Perf] Enable deepep-low-latency with round-robin expert placement. (#28449) · da2f6800
  Chen Bruce authored Nov 19, 2025
```
Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  da2f6800
17 Nov, 2025 1 commit

[Performance][Fix] update nvfp4 code to support renorm routing (#28569) · 561253b3

jiahanc authored Nov 16, 2025


Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

561253b3

16 Nov, 2025 1 commit
- Feature: Support Relu2 in FusedMoE fp8 cutlass path (#27261) · 03ee4811
  amirkl94 authored Nov 16, 2025
  
  03ee4811
07 Nov, 2025 1 commit
- [Bugfix] Use latency MOE backend as default for Flashinfer and other misc fixes (#27439) · 72b1c2ae
  Pavani Majety authored Nov 07, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  72b1c2ae
05 Nov, 2025 1 commit

Bugfix: Cutlass FP8 FusedMoE bad scaling factors (#27255) · 6b7a8118

amirkl94 authored Nov 05, 2025


Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

6b7a8118

04 Nov, 2025 1 commit
- [Kernels] Isolate modular kernel code from FusedMoEMethodBase subclasses. (#27123) · 938772af
  bnellnm authored Nov 04, 2025
  
  938772af