Commits · dc917cceb877dfd13f98c538c4c96158047d98bd · OpenDAS / vllm_cscc

22 Jan, 2026 1 commit
- [MoE Refactor] Move `select_experts` from `FusedMoEQuantMethod` -> `FusedMoE` (#31996) · dc917cce
  bnellnm authored Jan 22, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  dc917cce
21 Jan, 2026 2 commits
- Bump Flashinfer to v0.6.1 (#30993) · 808d6fd7
  elvischenv authored Jan 22, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  808d6fd7
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68
18 Jan, 2026 1 commit
- [MoE Refactor] Separate Router into OO Classes (#30623) · 327a02d8
  bnellnm authored Jan 18, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  327a02d8
08 Jan, 2026 1 commit
- [Misc][Refactor] Add FusedMoERouter object (#30519) · e74698c2
  bnellnm authored Jan 08, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e74698c2
07 Jan, 2026 1 commit

[Misc] Improve error messages for unsupported types and parameters (#30593) · 0790f076

BlankR authored Jan 07, 2026


Signed-off-by: BlankR <hjyblanche@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

0790f076

02 Jan, 2026 1 commit
- Remove unused `use_marlin` variable in `Mxfp4MoEMethod` (#31549) · 1f43c121
  Vaibhav Sourirajan authored Jan 02, 2026
```
Signed-off-by: vaibhav sourirajan <vs2787@columbia.edu>
```
  1f43c121
20 Dec, 2025 1 commit

[MoE Refactor][5/N] Isolate zero expert to LongCatFlash (#28891) · 54c89243

baonudesifeizhai authored Dec 20, 2025

Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Signed-off-by: Dongjie Zou <85092850+baonudesifeizhai@users.noreply.github.com>
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

54c89243

18 Dec, 2025 1 commit

[LoRA] Set default MXFP4 LoRA backend to Marlin (#30598) · 9a5e9652

Xin Yang authored Dec 18, 2025


Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

9a5e9652

13 Dec, 2025 1 commit

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46

Roberto L. Castro authored Dec 13, 2025

Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4fa7ce46

09 Dec, 2025 1 commit

[MoE][Refactor] Remove most arguments to FusedMoEMethodBase.apply (#29066) · 00e5cbb9

bnellnm authored Dec 09, 2025

Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>

00e5cbb9

30 Nov, 2025 1 commit

[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708) · a491b091

Xin Yang authored Nov 29, 2025


Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a491b091

29 Nov, 2025 1 commit

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

28 Nov, 2025 2 commits
- Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
  Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  3fd1fb0b
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971) · 745a3bae
  Xin Yang authored Nov 27, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  745a3bae
27 Nov, 2025 1 commit
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
25 Nov, 2025 1 commit
- Change warning logs to debug for unimplemented MXFP4 Linear/Attention (#29441) · 7df02897
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  7df02897
24 Nov, 2025 2 commits
- [Bugfix] Only use triton_kernels for MXFP4 on SM90 and SM100 (#29339) · c17610e2
  Michael Goin authored Nov 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c17610e2
- [MoE][Refactor] Make select_experts a non-static method (#29067) · 8f066146
  bnellnm authored Nov 24, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  8f066146
19 Nov, 2025 1 commit
- [Bugfix] Fix FusedMoEModularKernel for triton backend (#28913) · 468a8d72
  Xin Yang authored Nov 18, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  468a8d72
17 Nov, 2025 1 commit
- [Bugfix] Fix GPT-OSS on AMD after #28603 (#28816) · f8b19c0f
  Zhewen Li authored Nov 17, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  f8b19c0f
13 Nov, 2025 1 commit
- [BugFix] Fix type error when assign a trition kernel tensor to a torch.nn.Parameter (#28603) · 5e973209
  Zijing Liu authored Nov 13, 2025
```
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
```
  5e973209
12 Nov, 2025 1 commit
- Fix pre-commit (and XPU) on `main` (#28556) · 54aecd9e
  Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  54aecd9e
11 Nov, 2025 3 commits
- [Bugfix] Disable shared expert overlap if Marlin MoE is used (#28410) · e5f599d4
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e5f599d4
- [Quantization] fix attention quantization of gpt_oss model (#27334) · 5a1271d8
  xuebwang-amd authored Nov 12, 2025
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
```
  5a1271d8
- [Kernels] Split up fused_moe/layer.py, isolate more modular kernel code (#28064) · a1448b4b
  bnellnm authored Nov 11, 2025
  
  a1448b4b
08 Nov, 2025 1 commit
- [XPU] Enable Expert parallel for MoE models (#28263) · 1aaecda0
  Kunshang Ji authored Nov 08, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  1aaecda0
07 Nov, 2025 1 commit

[amd][gptoss] Perf gain because of block alignment (#28024) · 11fd69dd

smit kadvani authored Nov 06, 2025


Signed-off-by: Smit Kadvani <smit.kadvani@gmail.com>
Co-authored-by: Smit Shaileshbhai Kadvani <kadvani@meta.com>

11fd69dd

05 Nov, 2025 1 commit
- [XPU] Add gpt-oss model support for Intel GPU (#27786) · 18b39828
  Kunshang Ji authored Nov 05, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  18b39828
04 Nov, 2025 2 commits
- [Kernels] Isolate modular kernel code from FusedMoEMethodBase subclasses. (#27123) · 938772af
  bnellnm authored Nov 04, 2025
  
  938772af
- [BugFix][Performance] Restore flashinfer autotuning for all scenarios (#27904) · 4022a9d2
  Varun Sundar Rabindranath authored Nov 04, 2025
  
  4022a9d2
27 Oct, 2025 2 commits
- [Bugfix][LoRA][FusedMoE] Select MxFP4 Backend based on LoRA Enablement (#27487) · 5d3be3ba
  Varun Sundar Rabindranath authored Oct 27, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  5d3be3ba
- [Misc] Clean up utils (#27552) · 7c2bdb83
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c2bdb83
24 Oct, 2025 2 commits

[Misc][DP] Guard mxfp4 implementation selection (#27484) · 269c4db0

Varun Sundar Rabindranath authored Oct 24, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

269c4db0

[MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922

fhl2000 authored Oct 24, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

284cc922

22 Oct, 2025 1 commit

[Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3

dongbo910220 authored Oct 22, 2025

Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3ae082c3

21 Oct, 2025 1 commit

[Bugfix] Fix gpt-oss w4a8 DP/EP on B200 (#26729) · 5ff5d94e

Varun Sundar Rabindranath authored Oct 21, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

5ff5d94e

18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
16 Oct, 2025 2 commits
- [NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#26714) · 41d30719
  jiahanc authored Oct 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  41d30719
- [GPTOSS][DP/EP][Marlin] Enable GPTOSS Batched DP/EP using Marlin kernels (#25997) · fb0571b0
  Varun Sundar Rabindranath authored Oct 16, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fb0571b0