Commits · e1e318af010b4f92d39324d03231cfd409766bf9 · OpenDAS / vllm_cscc

14 Apr, 2026 2 commits

[MoE Refactor] Remove MoE DP chunking (#39107) · e1e318af

bnellnm authored Apr 14, 2026


Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

e1e318af

[fix][MOE] Fix MOE experts `intermediate_size` dimension not being narrowed... · 4eee77b8

fxmarty-amd authored Apr 14, 2026


[fix][MOE] Fix MOE experts `intermediate_size` dimension not being narrowed before weight loading (#39688)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>

4eee77b8

13 Apr, 2026 1 commit
- [Bugfix] [Tests] Enforce `out` tensor device in `kernel/moe/test_cutedsl_moe.py` (#39644) · 620e8924
  Yongye Zhu authored Apr 12, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  620e8924
10 Apr, 2026 1 commit
- Add platform manual_seed_all API (#38468) · ec68d53b
  Yan Ma authored Apr 10, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  ec68d53b
09 Apr, 2026 2 commits

[UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980) · eb4205fe

Michael Goin authored Apr 09, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

eb4205fe

[Bugfix] FlashInfer MXINT4 MoE crashes, missing do_finalize (#39315) · 8332078c

Benjamin Chislett authored Apr 08, 2026

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8332078c

08 Apr, 2026 1 commit

[MoE] Move DEEP_GEMM into experts/ subdirectory (#39005) · a776a48b

Jackmin801 authored Apr 08, 2026


Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

a776a48b

07 Apr, 2026 1 commit
- [Kernels][MoE] Fix legacy_routing to use bitmatrix-based routing path (#38504) · 2df2c85b
  Andreas Karatzas authored Apr 06, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  2df2c85b
06 Apr, 2026 2 commits

[Quantization] Add FlashInfer CuteDSL batched experts backend for NVFP4 MoE (#38251) · e8ebbdde

Yongye Zhu authored Apr 06, 2026


Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e8ebbdde

[MoE Refactor][Test] FusedMoE layer test (#24675) · f0148240

bnellnm authored Apr 06, 2026


Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

f0148240

02 Apr, 2026 2 commits
- [CPU] Support gelu act in cpu_fused_moe (#38770) · c6f722b9
  Li, Jiang authored Apr 02, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  c6f722b9
- Revert "[Kernel] Add gpt-oss Router GEMM kernel (#37205)" (#38778) · 9bd72311
  Xin Yang authored Apr 01, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  9bd72311
01 Apr, 2026 2 commits
- [Kernel] Add MXFP8 to Marlin GEMM/MoE and refactor Mxfp8LinearOp (#34664) · db5d0719
  Michael Goin authored Apr 01, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  db5d0719
- [MoE Refactor] Make SharedExperts class for use with DefaultMoERunner (#35153) · 7cf56a59
  bnellnm authored Apr 01, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  7cf56a59
31 Mar, 2026 3 commits

[MoE Refactor] Migrate Unquantized to Full Oracle Flow (#36286) · d9b90a07

yzong-rh authored Mar 31, 2026


Signed-off-by: Yifan Zong <yzong@redhat.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: yzong-rh <yzong@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

d9b90a07

[Bugfix] Fix FusedMoE weight loading with padded hidden dimensions (#37010) · 3896e021
SandishKumarHN authored Mar 31, 2026
```
Signed-off-by: SandishKumarHN <sandish@fb.com>
```
3896e021

replace cuda_device_count_stateless() to current_platform.device_count() (#37841) · 4dfad17e

wliao2 authored Mar 31, 2026


Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

4dfad17e

30 Mar, 2026 2 commits
- [EPLB] Optmize eplb mapping and record in router for prefill (#36261) · 12701e8a
  Ilya Markov authored Mar 30, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  12701e8a
- [NVIDIA] Bugfix NVFP4 DGX Spark and RTX50 (#38423) · b4a2f3ac
  Johnny authored Mar 30, 2026
```
Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnynuca14@gmail.com>
```
  b4a2f3ac
26 Mar, 2026 2 commits
- [ROCm][CI] Fix AITER state leak in shared_fused_moe_routed_transform test (#38137) · bdc1719e
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  bdc1719e
- Revert "[MoE Kernel] Flashinfer nvfp4 cutedsl moe kernel integration" (#38050) (#38169) · be1a85b7
  Zhewen Li authored Mar 26, 2026
```
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>
```
  be1a85b7
25 Mar, 2026 2 commits
- [ROCm] Fix MoE kernel test failures on gfx950 (#37833) · 7d6917be
  Andreas Karatzas authored Mar 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  7d6917be
- [MoE Kernel] Flashinfer nvfp4 cutedsl moe kernel integration (#38050) · 678b3c99
  Yongye Zhu authored Mar 25, 2026
  
  678b3c99
23 Mar, 2026 1 commit

[Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007) · dc6908ac

Ranran authored Mar 23, 2026


Signed-off-by: Ranran <1012869439@qq.com>
Signed-off-by: Ranran <hzz5361@psu.edu>
Signed-off-by: ran <hzz5361@psu.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

dc6908ac

22 Mar, 2026 1 commit
- [MoE] Move PF Methods to Folder (#35927) · 4383f153
  Robert Shaw authored Mar 22, 2026
  
  4383f153
21 Mar, 2026 2 commits
- [MoE] Move FlashInfer CuteDSL experts into fused_moe/experts/ (#37759) · 6b2fa3a7
  Robert Shaw authored Mar 21, 2026
```
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
```
  6b2fa3a7
- [MoE Refactor] Mxfp4 oracle rebased (#37128) · 87bd9189
  Yongye Zhu authored Mar 20, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  87bd9189
20 Mar, 2026 1 commit
- [Perf] Eliminate redundant SparseMatrix creation in gpt_oss_triton_kernels (#37683) · d0532bf3
  Xin Yang authored Mar 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d0532bf3
19 Mar, 2026 1 commit

[CI][BugFix][AMD] Don't set VLLM_ROCM_USE_AITER anymore in... · 98ff0429

rasmith authored Mar 19, 2026


[CI][BugFix][AMD] Don't set VLLM_ROCM_USE_AITER anymore in test_rocm_aiter_topk since its not necessary (#36996)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

98ff0429

18 Mar, 2026 1 commit
- [Kernel] Add gpt-oss Router GEMM kernel (#37205) · b1169d7b
  Xin Yang authored Mar 18, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1169d7b
17 Mar, 2026 1 commit
- [Torch 2.11] Guard torch._C._cpu attribute checks for forward compatibility (#35673) · 68f783a7
  Andrey Talman authored Mar 17, 2026
```
Signed-off-by: atalman <atalman@fb.com>
```
  68f783a7
16 Mar, 2026 1 commit

[Kernel] Add FlashInfer MoE A2A Kernel (#36022) · 2754231b

leo-cf-tian authored Mar 16, 2026


Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Leo Tian <lctian@nvidia.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: root <root@lyris0267.lyris.clusters.nvidia.com>

2754231b

12 Mar, 2026 3 commits

[Feature]: Remove Chunking From FusedMoE (#34086) · 2cdf9222

Xinan Miao authored Mar 13, 2026


Signed-off-by: SouthWest7 <am1ao@qq.com>
Signed-off-by: Southwest <1403572259@qq.com>
Signed-off-by: southwest <am1ao@qq.com>
Signed-off-by: Xinan Miao <1403572259@qq.com>
Co-authored-by: SouthWest7 <am1ao@qq.com>

2cdf9222

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
53ec16a7

[Perf] Add TRTLLM FP8 MoE Modular Kernel (#36307) · 2e693f48

Wei Zhao authored Mar 12, 2026


Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

2e693f48

08 Mar, 2026 1 commit
- Add support for ModelOpt MXFP8 MoE models (#35986) · 0a6a3a12
  danisereb authored Mar 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  0a6a3a12
05 Mar, 2026 2 commits

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

[Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
66a22096

04 Mar, 2026 1 commit

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63