Commits · 48a65ccb02a19f3b9755c13e8c3a4e8d5a368cc7 · OpenDAS / vllm_cscc

18 Apr, 2026 1 commit

[CI] Speed up test_fused_marlin_moe (#40178) · 48a65ccb

Michael Goin authored Apr 17, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>

48a65ccb

17 Apr, 2026 1 commit
- Remove outdated tests test_mixtral_moe and test_duplicated_ignored_sequence_group (#40175) · 1f45e837
  Michael Goin authored Apr 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1f45e837
14 Apr, 2026 1 commit

[MoE Refactor] Remove MoE DP chunking (#39107) · e1e318af

bnellnm authored Apr 14, 2026


Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

e1e318af

10 Apr, 2026 1 commit
- Add platform manual_seed_all API (#38468) · ec68d53b
  Yan Ma authored Apr 10, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  ec68d53b
01 Apr, 2026 1 commit
- [Kernel] Add MXFP8 to Marlin GEMM/MoE and refactor Mxfp8LinearOp (#34664) · db5d0719
  Michael Goin authored Apr 01, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  db5d0719
31 Mar, 2026 1 commit

[MoE Refactor] Migrate Unquantized to Full Oracle Flow (#36286) · d9b90a07

yzong-rh authored Mar 31, 2026


Signed-off-by: Yifan Zong <yzong@redhat.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: yzong-rh <yzong@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

d9b90a07

12 Mar, 2026 2 commits

[Feature]: Remove Chunking From FusedMoE (#34086) · 2cdf9222

Xinan Miao authored Mar 13, 2026


Signed-off-by: SouthWest7 <am1ao@qq.com>
Signed-off-by: Southwest <1403572259@qq.com>
Signed-off-by: southwest <am1ao@qq.com>
Signed-off-by: Xinan Miao <1403572259@qq.com>
Co-authored-by: SouthWest7 <am1ao@qq.com>

2cdf9222

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
53ec16a7

05 Mar, 2026 1 commit
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
04 Mar, 2026 1 commit

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

17 Feb, 2026 1 commit
- [Bugfix] Fix fused MoE int32 overflow in stride*offset without perf regression (#34507) · b68fd899
  haosdent authored Feb 17, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  b68fd899
12 Feb, 2026 1 commit
- [Refactor] Replace `activation: str` with `MoEActivation` enum (#33843) · ff1f83b0
  Michael Goin authored Feb 11, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  ff1f83b0
11 Feb, 2026 1 commit

[NVIDIA][test] Tests for flashinfer TRTLLM BF16 MoE (#33715) · 275e0d2a

Linda authored Feb 11, 2026


Signed-off-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>

275e0d2a

05 Feb, 2026 1 commit
- [Moe Refactor] Make Inplace Flag for FusedMoEModularKernel part of the constructor (#33375) · a57c8228
  bnellnm authored Feb 05, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  a57c8228
31 Jan, 2026 1 commit
- [Misc] Fix flashinfer related tests (#33462) · 63c08894
  Roy Wang authored Feb 01, 2026
```
Signed-off-by: esmeetu <jasonailu87@gmail.com>
```
  63c08894
30 Jan, 2026 1 commit
- Fix `test_moe.py` for Transformers v5 (#33413) · a11bc12d
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a11bc12d
27 Jan, 2026 1 commit
- [torch.compile] Speed up MOE handling in forward_context (#33184) · d9aa39a3
  Richard Zou authored Jan 27, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  d9aa39a3
23 Jan, 2026 1 commit
- [CPU Backend][BugFix] Fix failing CPU MoE test (#32876) · aac0b817
  Fadi Arafeh authored Jan 23, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  aac0b817
22 Jan, 2026 2 commits
- [MoE Refactor] Move `select_experts` from `FusedMoEQuantMethod` -> `FusedMoE` (#31996) · dc917cce
  bnellnm authored Jan 22, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  dc917cce
- [torch.compile] Improve Cold Start for MoEs (#32805) · 654a71fc
  Richard Zou authored Jan 22, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  654a71fc
21 Jan, 2026 1 commit
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68
18 Jan, 2026 2 commits
- [MoE Refactor] Separate Router into OO Classes (#30623) · 327a02d8
  bnellnm authored Jan 18, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  327a02d8
- [MoE Refactor] Move Test Impl into Test Dirs (#32129) · 4a6af881
  Robert Shaw authored Jan 17, 2026
```
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
```
  4a6af881
16 Jan, 2026 1 commit

[Feat] Support non-gated MoE with Marlin, NVFP4 CUTLASS, FP8, INT8, compressed-tensors (#32257) · c277fbdf

TomerBN-Nvidia authored Jan 16, 2026


Signed-off-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Tomer Natan <tbarnatan@ipp1-1429.ipp1a1.colossus.nvidia.com>

c277fbdf

14 Jan, 2026 1 commit
- AMD CI Test - unskip moe_sum test and moe_align_block_size tests (#32039) · 048bb597
  Hongxia Yang authored Jan 14, 2026
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
```
  048bb597
13 Jan, 2026 1 commit
- fix(rocm): Use refresh_env_variables() for rocm_aiter_ops in test_moe (#31711) · 69f8a0ea
  Rabi Mishra authored Jan 14, 2026
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  69f8a0ea
09 Jan, 2026 1 commit
- Add unpermute-aware fused MoE path and small-batch fallback (#29354) · a4d5d663
  Runkai Tao authored Jan 09, 2026
```
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a4d5d663
08 Jan, 2026 1 commit

[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues... · 6cdf015c

Lucas Wilkinson authored Jan 08, 2026


[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues in the future (#31747)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

6cdf015c

05 Jan, 2026 1 commit
- [Platform] Deprecate seed_everything (#31659) · bb4337b3
  wangxiyuan authored Jan 05, 2026
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  bb4337b3
22 Dec, 2025 1 commit
- [MoE Refactor][9/N] Use modular kernel for unquantized Triton MoE (#31052) · 7b926e89
  Yongye Zhu authored Dec 22, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  7b926e89
12 Dec, 2025 1 commit
- [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
  Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3e41992f
07 Dec, 2025 1 commit

[Kernel][MoE] optimize `moe_align_block_size` (#29642) · 879ddb09

Jinzhen Lin authored Dec 07, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

879ddb09

29 Nov, 2025 1 commit

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

15 Nov, 2025 1 commit
- [Misc] Make `SchedulerConfig.max_model_len` init-only (#28733) · 638e4196
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  638e4196
10 Nov, 2025 1 commit

[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like... · f080a835

vllmellm authored Nov 10, 2025


[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like `_custom_ops` and `_ipex_ops` (#24490)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f080a835

30 Oct, 2025 1 commit

kernels/moe test pruning (#27053) · b8c48c5d

Fardin Hoque authored Oct 29, 2025


Signed-off-by: Fardin Hoque <kfhfar@amazon.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

b8c48c5d

16 Oct, 2025 1 commit
- [GPTOSS][DP/EP][Marlin] Enable GPTOSS Batched DP/EP using Marlin kernels (#25997) · fb0571b0
  Varun Sundar Rabindranath authored Oct 16, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fb0571b0
14 Oct, 2025 1 commit

[torch.compile] Unwrap fused_marlin_moe custom op (#26739) · 8ae16928

Varun Sundar Rabindranath authored Oct 13, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

8ae16928

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a