Commits · 333529deae59cd4100df540f225470c9bc539bee · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "74fc2d77aec13304550bb52b459bd8c6da756d39"

24 Apr, 2026 3 commits
- [EPLB] Fix replica selection bias in fused_moe router (#40810) · 333529de
  Artem Perevedentsev authored Apr 25, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
```
  333529de
- [MoE] Move cutlass moe to fused_moe/experts/ (#40574) · 079a4cf3
  Jackmin801 authored Apr 23, 2026
```
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  079a4cf3
- [MoE] Move remaining PrepareAndFinalize to prepare finalize folder (#39009) · 447c372a
  Jackmin801 authored Apr 23, 2026
```
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>
```
  447c372a
22 Apr, 2026 3 commits

[Bugfix] LoRA for DeepSeek V3.2 (#35077) · a250f1bd

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Apr 22, 2026


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a250f1bd

[AMD][CI][BugFix] Override normalize_e4m3fn_to_e4m3fnuz for fnuz machines in... · 2463f00f

rasmith authored Apr 21, 2026


[AMD][CI][BugFix] Override normalize_e4m3fn_to_e4m3fnuz for fnuz machines in test_moe_layer_no_parallel (#40550)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

2463f00f

test: add nan/inf clamp regression test for fused_topk_bias (#40553) · 46794958
Jhao-Ting Chen authored Apr 21, 2026
```
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
```
46794958

21 Apr, 2026 5 commits

[MoE Refactor] Add more MoE layer tests (#39349) · 9db4650e

bnellnm authored Apr 21, 2026

Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

9db4650e

[MoE Refactor] Remove SharedFusedMoE class (#35782) · 5e584ce9
bnellnm authored Apr 21, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
5e584ce9

Revert #38730 and #38791 (#40032) · 6d85b36a

Vadim Gimpelson authored Apr 21, 2026


Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>

6d85b36a

fix: clamp NaN/Inf in topk_softmax to prevent duplicate expert IDs (#39391) · 28c22215
Jhao-Ting Chen authored Apr 21, 2026
```
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
```
28c22215

[vLLM IR] Add IR op testing and benchmarking infrastructure (#40167) · fe5c115e

Yanan Cao authored Apr 20, 2026


Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Theresa Shan <Theresa.Shan@amd.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

fe5c115e

20 Apr, 2026 3 commits
- Update flashinfer to 0.6.8 (#39959) · 191e3fda
  bai authored Apr 20, 2026
```
Signed-off-by: bai <v@gor.io>
```
  191e3fda
- [MoE Refactor] Move the shared/fused expert output sum into MoERunnerBase (#35949) · 726efe17
  bnellnm authored Apr 20, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  726efe17
- [XPU] enable triton attention test on XPU by removing cuda device binding (#39627) · e06de7f0
  Yan Ma authored Apr 20, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  e06de7f0
19 Apr, 2026 2 commits
- Fix MoE backend selection for LoRA (unquantized MoE) (#40273) · d1135a50
  danisereb authored Apr 19, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  d1135a50
- [FEAT] [Perf] [Gemma4] Fused Gemma4 Routing Function Triton (#39083) · 45232a45
  TJian authored Apr 19, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  45232a45
18 Apr, 2026 1 commit

[CI] Speed up test_fused_marlin_moe (#40178) · 48a65ccb

Michael Goin authored Apr 17, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>

48a65ccb

17 Apr, 2026 3 commits
- Remove outdated tests test_mixtral_moe and test_duplicated_ignored_sequence_group (#40175) · 1f45e837
  Michael Goin authored Apr 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1f45e837
- [Kernel] Add MXFP4 W4A4 CUTLASS MoE kernel for SM100 (#37463) · a8bffaa1
  Michael Goin authored Apr 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  a8bffaa1
- Add nvfp4 support to reshape_and_cache_flash (#37332) · 6b2b7bd0
  sychen52 authored Apr 17, 2026
```
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
```
  6b2b7bd0
16 Apr, 2026 4 commits
- [Bugfix] Temporarily disable B200 fp4 MoE layer tests (#40057) · 79e799eb
  bnellnm authored Apr 16, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  79e799eb
- Gate SSU dispatch setup (#40039) · b897f00c
  roikoren755 authored Apr 16, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  b897f00c
- [Kernel][Helion] Fix inductor fusion of Helion HOP (#39944) · edc36489
  Yanan Cao authored Apr 16, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  edc36489
- [perf][cpu] Accelerate BF16 GELU with LUT impl on Arm CPUs (#37469) · 445b7093
  Fadi Arafeh authored Apr 16, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  445b7093
14 Apr, 2026 6 commits
- [MoE Refactor] Refactor ZeroExpertFusedMoE into new framework (#35549) · 19ec9a0a
  bnellnm authored Apr 14, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  19ec9a0a
- [MoE] Move GPT OSS Triton kernel experts into fused_moe/experts/ (#39007) · 1a9353bb
  Jackmin801 authored Apr 14, 2026
```
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>
```
  1a9353bb
- [Mamba] Flashinfer selective_state_update (#36162) · ecf5ff7c
  roikoren755 authored Apr 14, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  ecf5ff7c
- [ROCm][CI] Fix condition for `test_per_token_group_quant_fp8_packed` (#39730) · 4f4f8eaa
  Micah Williamson authored Apr 14, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  4f4f8eaa
- [MoE Refactor] Remove MoE DP chunking (#39107) · e1e318af
  bnellnm authored Apr 14, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  e1e318af
- [fix][MOE] Fix MOE experts `intermediate_size` dimension not being narrowed... · 4eee77b8
  fxmarty-amd authored Apr 14, 2026
```
[fix][MOE] Fix MOE experts `intermediate_size` dimension not being narrowed before weight loading (#39688)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
```
  4eee77b8
13 Apr, 2026 1 commit
- [Bugfix] [Tests] Enforce `out` tensor device in `kernel/moe/test_cutedsl_moe.py` (#39644) · 620e8924
  Yongye Zhu authored Apr 12, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  620e8924
11 Apr, 2026 1 commit
- [Perf] Fuse Zero Initializer for FP8 DeepGemm Block Quant Kernel (#39547) · 59b2f7b6
  Wei Zhao authored Apr 11, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  59b2f7b6
10 Apr, 2026 3 commits

[Kernel] Porting the TRTLLM minimax_allreduce_rms kernels (#37045) · ecd1ea13
Jee Jee Li authored Apr 11, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
ecd1ea13

[Kernel][Hardware][AMD] Add TritonW4A16LinearKernel for ROCm (#37352) · d468322d

jatseng-ai authored Apr 10, 2026


Signed-off-by: jatseng-ai <jatseng@amd.com>
Signed-off-by: jatseng-ai <janet.tseng@amd.com>
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Matthias Gehre <matthias.gehre@amd.com>

d468322d

Add platform manual_seed_all API (#38468) · ec68d53b
Yan Ma authored Apr 10, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
ec68d53b

09 Apr, 2026 3 commits

[UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980) · eb4205fe

Michael Goin authored Apr 09, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

eb4205fe

[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8... · 2e9034c9

Maral authored Apr 09, 2026


[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8 block linear kernel selections. (#33892)
Signed-off-by: maral <maralbahari.98@gmail.com>
Signed-off-by: Maral <maralbahari.98@gmail.com>

2e9034c9

[Bugfix] FlashInfer MXINT4 MoE crashes, missing do_finalize (#39315) · 8332078c

Benjamin Chislett authored Apr 08, 2026

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8332078c

08 Apr, 2026 2 commits

[MoE] Move DEEP_GEMM into experts/ subdirectory (#39005) · a776a48b

Jackmin801 authored Apr 08, 2026


Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

a776a48b

[Perf][Kernel] Persistent TopK scheduler: unified CUDAGraph-safe kernel with... · b55d830e

Roberto L. Castro authored Apr 08, 2026


[Perf][Kernel] Persistent TopK scheduler: unified CUDAGraph-safe kernel with dynamic per-row dispatch - DeepSeek-V3.2 DSA decode (#37421)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

b55d830e