Commits · 2e693f48e7bd6fa621c8ce2c753ae76360793a04 · OpenDAS / vllm_cscc

12 Mar, 2026 1 commit

[Perf] Add TRTLLM FP8 MoE Modular Kernel (#36307) · 2e693f48

Wei Zhao authored Mar 12, 2026


Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

2e693f48

08 Mar, 2026 1 commit
- Add support for ModelOpt MXFP8 MoE models (#35986) · 0a6a3a12
  danisereb authored Mar 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  0a6a3a12
05 Mar, 2026 2 commits

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

[Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
66a22096

04 Mar, 2026 1 commit

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

02 Mar, 2026 2 commits
- [Core] Move test utility to test file (#35672) · 4034c3d3
  Turner Jabbour authored Mar 02, 2026
```
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
```
  4034c3d3
- [Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) · cb21972a
  EdalatiAli authored Mar 02, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  cb21972a
26 Feb, 2026 1 commit

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

25 Feb, 2026 1 commit
- [Bugfix] Fix expert_ids padding values in moe_align_block_size kernel (#35161) · 3bbb2046
  Xin Yang authored Feb 24, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  3bbb2046
22 Feb, 2026 1 commit

[Model] Add NVFP4 quantization support for Step3.5-Flash (#34478) · b7892a3b

tacos8me authored Feb 22, 2026


Signed-off-by: tacos8me <ian@cloudhabit.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

b7892a3b

20 Feb, 2026 1 commit
- [Kernel] Optimize grouped topk kernel (#34206) · b1c4f0b2
  Xin Yang authored Feb 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1c4f0b2
18 Feb, 2026 2 commits

[Bugfix][MoE Kernel] Fix incorrect routing selection for models without expert... · 847a57cd

Wenlong Wang authored Feb 18, 2026


[Bugfix][MoE Kernel] Fix incorrect routing selection for models without expert groups (e.g., MiniMax-M2.1) (#34673)
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

847a57cd

[CI][AMD][BugFix] Skip tests in test_unquantized_backend_selection that should... · fcd6ac97

rasmith authored Feb 18, 2026


[CI][AMD][BugFix] Skip tests in test_unquantized_backend_selection that should not run on ROCm (#34655)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

fcd6ac97

17 Feb, 2026 1 commit
- [Bugfix] Fix fused MoE int32 overflow in stride*offset without perf regression (#34507) · b68fd899
  haosdent authored Feb 17, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  b68fd899
15 Feb, 2026 1 commit
- [Bugfix] Handle num_expert_group=None in flashinfer block-scale FP8 MoE (#34494) · 79f3fab0
  haosdent authored Feb 15, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  79f3fab0
13 Feb, 2026 1 commit
- [Bugfix] fix the import path in moe test utils.py (#34245) · 742d214d
  Marek Michalowski authored Feb 13, 2026
```
Signed-off-by: Marek Michalowski <marek.michalowski@arm.com>
```
  742d214d
12 Feb, 2026 2 commits
- [Kernel] Support Flashinfer trtllm fused MoE non gated FP8 & NVFP4 (#33506) · f120bd42
  amitz-nv authored Feb 12, 2026
```
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>
```
  f120bd42
- [Refactor] Replace `activation: str` with `MoEActivation` enum (#33843) · ff1f83b0
  Michael Goin authored Feb 11, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  ff1f83b0
11 Feb, 2026 3 commits

Fix CI failure - Flashinfer Kernel tests (#34316) · 5aff2699
Wei Zhao authored Feb 11, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
5aff2699

[NVIDIA][test] Tests for flashinfer TRTLLM BF16 MoE (#33715) · 275e0d2a

Linda authored Feb 11, 2026


Signed-off-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>

275e0d2a

[MoE Refactor] Introduce MoERunner abstraction and move execution logic from... · d1481ba7

bnellnm authored Feb 10, 2026


[MoE Refactor] Introduce MoERunner abstraction and move execution logic from FusedMoE to DefaultMoERunner (#32344)
Signed-off-by: Bill Nell <bnell@redhat.com>

d1481ba7

10 Feb, 2026 1 commit

[ROCm][Quantization] GPT_OSS in amd-quark format model loading and emulations (#29008) · b129136c

xuebwang-amd authored Feb 10, 2026


Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

b129136c

08 Feb, 2026 1 commit
- [Release 2.10] Update to Torch 2.10 - final release (#30525) · f97ca671
  Andrey Talman authored Feb 08, 2026
  
  f97ca671
07 Feb, 2026 1 commit
- Fix spelling errors (#33978) · 15a0b9e5
  lukec authored Feb 07, 2026
  
  15a0b9e5
06 Feb, 2026 1 commit
- [Refactor] Remove align block size logic in `moe_permute` (#33449) · 77c09e11
  Wentao Ye authored Feb 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  77c09e11
05 Feb, 2026 2 commits

[Moe Refactor] Make Inplace Flag for FusedMoEModularKernel part of the constructor (#33375) · a57c8228
bnellnm authored Feb 05, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
a57c8228

[CI][AMD][BugFix] Ensure VLLM_ROCM_USE_AITER is set so test_rocm_aiter_topk.py... · c1395f72

rasmith authored Feb 04, 2026


[CI][AMD][BugFix] Ensure VLLM_ROCM_USE_AITER is set so test_rocm_aiter_topk.py can run correctly (#33840)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

c1395f72

03 Feb, 2026 1 commit
- [Misc] Remove deprecated VLLM_ALL2ALL_BACKEND environment variable (#33535) · b95cc501
  杨朱 · Kiki authored Feb 03, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  b95cc501
02 Feb, 2026 1 commit
- [MoE] Enable Shared/Routed Overlap For Latent MoE (Nemotron-H) (#32790) · 0aca8b8c
  danielafrimi authored Feb 02, 2026
```
Signed-off-by: dafrimi <dafrimi@nvidia.com>
```
  0aca8b8c
31 Jan, 2026 3 commits
- [Misc] Fix flashinfer related tests (#33462) · 63c08894
  Roy Wang authored Feb 01, 2026
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  63c08894
- Add support for Mistral Large 3 inference with Flashinfer MoE (#33174) · f0bca83e
  Dimitrios Bariamis authored Jan 31, 2026
```
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  f0bca83e
- Refactor NVFP4 Linear utils for ModelOpt and CT (#33201) · 67ebaff5
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67ebaff5
30 Jan, 2026 2 commits
- [Hardware][SM100] Add TRTLLM Kernel for INT4 W4A16 Kernel. (#32437) · c3a9752b
  Pavani Majety authored Jan 30, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  c3a9752b
- Fix `test_moe.py` for Transformers v5 (#33413) · a11bc12d
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a11bc12d
27 Jan, 2026 2 commits

[torch.compile] Speed up MOE handling in forward_context (#33184) · d9aa39a3
Richard Zou authored Jan 27, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
d9aa39a3

[MoE Refactor] Integrate Naive Prepare Finalize into MK (#32567) · 5a93b916

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: amirkl94 <203507526+amirkl94@users.noreply.github.com>

5a93b916

23 Jan, 2026 2 commits
- [CPU Backend][BugFix] Fix failing CPU MoE test (#32876) · aac0b817
  Fadi Arafeh authored Jan 23, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  aac0b817
- [Bugfix] Fix _CPU_MOE_ACT AssertionError when vLLM config not set (#32777) · fa6e599a
  Karan Bansal authored Jan 23, 2026
```
Signed-off-by: Karan Bansal <karanb192@gmail.com>
```
  fa6e599a
22 Jan, 2026 1 commit
- [MoE Refactor] Move `select_experts` from `FusedMoEQuantMethod` -> `FusedMoE` (#31996) · dc917cce
  bnellnm authored Jan 22, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  dc917cce