Commits · 00d7b497b33679a3ce641db9119eb09dd4ed5e30 · OpenDAS / vllm_cscc

06 Apr, 2026 1 commit

[NVFP4] Support NVFP4 dense models from `modelopt` and `compressed-tensors` on... · 00d7b497

fxmarty-amd authored Apr 07, 2026


[NVFP4] Support NVFP4 dense models from `modelopt` and `compressed-tensors` on AMD Instinct MI300, MI355X and Hopper through emulation (#35733)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>

00d7b497

01 Apr, 2026 2 commits
- [Kernel] Add MXFP8 to Marlin GEMM/MoE and refactor Mxfp8LinearOp (#34664) · db5d0719
  Michael Goin authored Apr 01, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  db5d0719
- [MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153) · 7cf56a59
  bnellnm authored Apr 01, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  7cf56a59
26 Mar, 2026 1 commit

[Bugfix][CI] Fix Marlin FP8 Linear Kernel for Compressed Tensors Format (#38092) · e6bf9f15

BadrBasowid authored Mar 26, 2026

Signed-off-by: BadrBasowid <Badr.Basowid@gmail.com>
Signed-off-by: BadrBasowid <61441185+BadrBasowid@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

e6bf9f15

16 Mar, 2026 2 commits

[Quant][Feature] Support online MXFP8 quantization for MoE and dense models (#35448) · e5b80760
EdalatiAli authored Mar 16, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
```
e5b80760

Fix eplb nvfp4 experts hook (#37217) · fd4d9630

Elvir Crnčević authored Mar 16, 2026


Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Signed-off-by: Elvir Crncevic <elvir@anthropic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

fd4d9630

08 Mar, 2026 1 commit
- Add support for ModelOpt MXFP8 MoE models (#35986) · 0a6a3a12
  danisereb authored Mar 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  0a6a3a12
03 Mar, 2026 1 commit

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

26 Feb, 2026 2 commits
- [Bugfix] Fix KV Scale loading for MLA Models (#35430) · 62830211
  Pavani Majety authored Feb 26, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  62830211
- add mixed precision support for modelopt (#35047) · d0105b84
  sychen52 authored Feb 26, 2026
```
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
```
  d0105b84
24 Feb, 2026 2 commits

Integrate flashinfer mm_mxfp8 in ModelOpt MXFP8 (#35053) · 9609b1f1
danisereb authored Feb 24, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
9609b1f1

[Refactor] [1/N] Reorganize kernel abstraction directory (#34055) · 6af03f23

BadrBasowid authored Feb 24, 2026


Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

6af03f23

16 Feb, 2026 1 commit
- Fix call to moe_mk in modelopt MoE modules (required for LoRA) (#34575) · ec7d9e67
  danisereb authored Feb 16, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  ec7d9e67
12 Feb, 2026 2 commits
- [Kernel] Support Flashinfer trtllm fused MoE non gated FP8 & NVFP4 (#33506) · f120bd42
  amitz-nv authored Feb 12, 2026
```
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>
```
  f120bd42
- [Refactor] Replace `activation: str` with `MoEActivation` enum (#33843) · ff1f83b0
  Michael Goin authored Feb 11, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  ff1f83b0
11 Feb, 2026 1 commit

[MoE Refactor] Introduce MoERunner abstraction and move execution logic from... · d1481ba7

bnellnm authored Feb 10, 2026


[MoE Refactor] Introduce MoERunner abstraction and move execution logic from FusedMoE to DefaultMoERunner (#32344)
Signed-off-by: Bill Nell <bnell@redhat.com>

d1481ba7

09 Feb, 2026 1 commit
- [Bugfix] Fix shared expert input for latent MoE in EP+DP (Nemotron-H) (#34087) · 995bbf38
  TomerBN-Nvidia authored Feb 09, 2026
```
Signed-off-by: Tomer Natan <tbarnatan@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  995bbf38
08 Feb, 2026 1 commit
- Add support for ModelOpt MXFP8 dense models (#33786) · 084aa19f
  danisereb authored Feb 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  084aa19f
05 Feb, 2026 1 commit
- [Moe Refactor] Make Inplace Flag for FusedMoEModularKernel part of the constructor (#33375) · a57c8228
  bnellnm authored Feb 05, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  a57c8228
31 Jan, 2026 1 commit
- Refactor NVFP4 Linear utils for ModelOpt and CT (#33201) · 67ebaff5
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67ebaff5
30 Jan, 2026 1 commit

[Misc] Replace Optional[X] with X | None syntax (#33332) · 1a7894db

杨朱 · Kiki authored Jan 30, 2026


Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

1a7894db

27 Jan, 2026 3 commits

Support compress-tensors with nvfp4 or fp8 weights and modelopt with nvfp4... · 66e601ef

IriKa authored Jan 28, 2026


Support compress-tensors with nvfp4 or fp8 weights and modelopt with nvfp4 weights on Turing (#33076)
Signed-off-by: IriKa Qiu <qiujie.jq@gmail.com>

66e601ef

[5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
a608b4c6

[MoE Refactor] Integrate Naive Prepare Finalize into MK (#32567) · 5a93b916

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: amirkl94 <203507526+amirkl94@users.noreply.github.com>

5a93b916

26 Jan, 2026 1 commit

[FIX] Always support TP > 4 for FP4 Gemm (#31099) · 67fe677c

danielafrimi authored Jan 26, 2026


Signed-off-by: dafrimi <dafrimi@nvidia.com>
Co-authored-by: root <root@gpu-51.slurm-workers-slurm.slurm.svc.cluster.local>

67fe677c

25 Jan, 2026 1 commit
- [Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
  Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  fcb9df99
22 Jan, 2026 1 commit
- [MoE Refactor] Move `select_experts` from `FusedMoEQuantMethod` -> `FusedMoE` (#31996) · dc917cce
  bnellnm authored Jan 22, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  dc917cce
21 Jan, 2026 1 commit
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68
20 Jan, 2026 1 commit
- [Refactor] Make FP8 Linear Ops use kernel abstraction (#27814) · 148117ea
  vllmellm authored Jan 20, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  148117ea
19 Jan, 2026 1 commit

[BugFix] Fix TRT-LLM NVFP4 DP/EP (#32349) · 73503317

jiahanc authored Jan 19, 2026


Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

73503317

18 Jan, 2026 1 commit
- [MoE Refactor] Separate Router into OO Classes (#30623) · 327a02d8
  bnellnm authored Jan 18, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  327a02d8
16 Jan, 2026 1 commit

[Feat] Support non-gated MoE with Marlin, NVFP4 CUTLASS, FP8, INT8, compressed-tensors (#32257) · c277fbdf

TomerBN-Nvidia authored Jan 16, 2026


Signed-off-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Tomer Natan <tbarnatan@ipp1-1429.ipp1a1.colossus.nvidia.com>

c277fbdf

13 Jan, 2026 1 commit

[Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding (#30885) · 8ef50d9a

Roberto L. Castro authored Jan 14, 2026

Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>

8ef50d9a

08 Jan, 2026 3 commits

[Misc][Refactor] Add FusedMoERouter object (#30519) · e74698c2
bnellnm authored Jan 08, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
e74698c2

[MoE Refactor][16/N] Apply Refactor to NVFP4 (#31692) · 9f6dcb71

Robert Shaw authored Jan 07, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>

9f6dcb71

[MoE Refactor][15/N] Apply Refactor to Fp8 (#31415) · 5dcd7ef1
Robert Shaw authored Jan 07, 2026

5dcd7ef1

06 Jan, 2026 1 commit
- [MoE Refactor][14/N] Clean Up FI Quant Config Smuggling (#31593) · af8fd730
  Robert Shaw authored Jan 06, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  af8fd730
05 Jan, 2026 1 commit

[Bugfix] Fix Broken ModelOpt NVFP4 MoE (#31742) · f6c0009a

Robert Shaw authored Jan 05, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

f6c0009a

03 Jan, 2026 1 commit

[MoE Refactor][13/N] Convert FI to Use PFNoEP (#31533) · 268b1c55

Robert Shaw authored Jan 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

268b1c55

22 Dec, 2025 1 commit
- [Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN... · 19cc9468
  CedricHuang authored Dec 22, 2025
```
[Feature]: Support NVIDIA ModelOpt HF FP8 variants FP8_PER_CHANNEL_PER_TOKEN and FP8_PB_WO  in vLLM (#30957)
```
  19cc9468