Commits · 98ff0429175b98169e1ebffd5ff32d0635bd39cc · OpenDAS / vllm_cscc

19 Mar, 2026 1 commit

[CI][BugFix][AMD] Don't set VLLM_ROCM_USE_AITER anymore in... · 98ff0429

rasmith authored Mar 19, 2026


[CI][BugFix][AMD] Don't set VLLM_ROCM_USE_AITER anymore in test_rocm_aiter_topk since its not necessary (#36996)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

98ff0429

18 Mar, 2026 3 commits
- [Kernel] Add gpt-oss Router GEMM kernel (#37205) · b1169d7b
  Xin Yang authored Mar 18, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1169d7b
- [ROCm][CI] Skip trtllm kvfp8 dequant tests on ROCm (#37330) · 58cde5c0
  Andreas Karatzas authored Mar 17, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  58cde5c0
- [Kernel][Helion] [16/N] Refactor register_kernel API to be more Dynamo-friendly (#36705) · ff9fbc9a
  Yanan Cao authored Mar 17, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  ff9fbc9a
17 Mar, 2026 2 commits
- [Torch 2.11] Guard torch._C._cpu attribute checks for forward compatibility (#35673) · 68f783a7
  Andrey Talman authored Mar 17, 2026
```
Signed-off-by: atalman <atalman@fb.com>
```
  68f783a7
- Support non-contiguous KV cache in TRTLLM fp8 dequant kernel (#36867) · 6c1cfbad
  Vadim Gimpelson authored Mar 17, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>
Co-authored-by: Pavani Majety <pavanimajety@gmail.com>
```
  6c1cfbad
16 Mar, 2026 3 commits

[Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · 3e6a1e16
Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
3e6a1e16
[Bugfix] opcheck false mutation error in rms_norm_per_block_quant (#36688) (#36779) · c0f01191
Krish Gupta authored Mar 17, 2026
```
Signed-off-by: Krish Gupta <krishom70@gmail.com>
```
c0f01191

[Kernel] Add FlashInfer MoE A2A Kernel (#36022) · 2754231b

leo-cf-tian authored Mar 16, 2026


Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Leo Tian <lctian@nvidia.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: root <root@lyris0267.lyris.clusters.nvidia.com>

2754231b

12 Mar, 2026 8 commits
- [Feature]: Remove Chunking From FusedMoE (#34086) · 2cdf9222
  Xinan Miao authored Mar 13, 2026
```
Signed-off-by: SouthWest7 <am1ao@qq.com>
Signed-off-by: Southwest <1403572259@qq.com>
Signed-off-by: southwest <am1ao@qq.com>
Signed-off-by: Xinan Miao <1403572259@qq.com>
Co-authored-by: SouthWest7 <am1ao@qq.com>
```
  2cdf9222
- [Bugfix] fix main branch pre-commit error (1 line change) (#36897) · 85199f96
  SoluMilken authored Mar 13, 2026
```
Signed-off-by: SoluMilken <ypiheyn.imm02g@g2.nctu.edu.tw>
```
  85199f96
- [Kernel] Add FP8 KV cache support to Triton MLA decode attention (#34597) · a1257fd1
  grimulkan authored Mar 12, 2026
```
Signed-off-by: grimulkan <grimulkan@gmail.com>
```
  a1257fd1
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- [Perf] Add TRTLLM FP8 MoE Modular Kernel (#36307) · 2e693f48
  Wei Zhao authored Mar 12, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  2e693f48
- [Perf] add packed recurrent fast path for decode (#36596) · 9e19f833
  caozuoba authored Mar 12, 2026
```
Signed-off-by: hdj <1293066020@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  9e19f833
- [MM][OOT] Support CPU `seq_lens` for OOT MMEncoderAttention kernels (#36605) · f0d3658c
  Shanshan Shen authored Mar 12, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  f0d3658c
- [Kernel][Helion][13/N] Force static_shapes=False in helion register (#36677) · 584a3f56
  Yanan Cao authored Mar 11, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  584a3f56
11 Mar, 2026 4 commits

[Kernel] [Helion] [15/N] Split config files into per-platform files (#36698) · cf632499
Yanan Cao authored Mar 11, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
cf632499

[torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551) · 9556af87

Luka Govedič authored Mar 11, 2026

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>

9556af87

Add 320 dimension size support to MLA (#36161) · a5d06dc5
Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
a5d06dc5
Add XPU MLA Sparse backend for DeepSeek v3.2 (#33230) · e584dce5
Wuxun Zhang authored Mar 11, 2026
```
Signed-off-by: Zhang, Wuxun <wuxun.zhang@intel.com>
```
e584dce5

10 Mar, 2026 1 commit
- Improvements to wvSplitKrc skinny GEMM solution (#34304) · 721ae79f
  Hashem Hashemi authored Mar 10, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  721ae79f
09 Mar, 2026 5 commits
- [Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA... · 580864d8
  Roberto L. Castro authored Mar 09, 2026
```
[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
```
  580864d8
- [Attention][Perf] Optimize cp_gather_and_upconvert_fp8_kv_cache - DeepSeek-v3.2 (#35290) · 2b28b9b2
  Roberto L. Castro authored Mar 09, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  2b28b9b2
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
- [MM Encoder] Default to use TORCH_SDPA backend for ViT on Volta/Turing GPU (#36472) · b0906d8b
  Isotr0py authored Mar 09, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b0906d8b
- [Kernel] Add fused_sigmoid_gating_delta_rule_update kernel for Qwen3 Next (#35777) · dc6b5784
  Xin Yang authored Mar 08, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  dc6b5784
08 Mar, 2026 1 commit
- Add support for ModelOpt MXFP8 MoE models (#35986) · 0a6a3a12
  danisereb authored Mar 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  0a6a3a12
06 Mar, 2026 2 commits

Enabling some B200-specific tests on MI355 (#35253) · 225d1090

Alexei-V-Ivanov-AMD authored Mar 06, 2026


Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
Signed-off-by: Alexei-V-Ivanov-AMD <156011006+Alexei-V-Ivanov-AMD@users.noreply.github.com>

225d1090

[CustomOp] CustomOp FusedRMSNormGated (#35877) · f3c6c9c9

eellison authored Mar 06, 2026


Signed-off-by: Elias Ellison <elias.ellison@gmail.com>
Signed-off-by: eellison <elias.ellison@gmail.com>

f3c6c9c9

05 Mar, 2026 3 commits
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [ROCm] Refactor ROCm attention backend selection logic (#35246) · 8c760b6a
  Sage Moore authored Mar 05, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  8c760b6a
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
04 Mar, 2026 3 commits
- [CI] Bump `mypy` version (#34950) · 17dc9c7f
  Harry Mellor authored Mar 04, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  17dc9c7f
- [Misc] Add `--attention-backend auto` option (#35738) · 18e01a0a
  Nicolò Lucchesi authored Mar 04, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  18e01a0a
- [Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d
  Kunshang Ji authored Mar 04, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  16d2ad1d
03 Mar, 2026 2 commits

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

TRTLLM gen-full attn Test Coverage (#34986) · e05cb3b9

ojhaanshika authored Mar 03, 2026


Signed-off-by: Anshika Ojha <anshikao@nvidia.com>
Co-authored-by: Anshika Ojha <anshikao@gb-nvl-059-compute09.nvidia.com>

e05cb3b9

02 Mar, 2026 2 commits
- [Core] Move test utility to test file (#35672) · 4034c3d3
  Turner Jabbour authored Mar 02, 2026
```
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
```
  4034c3d3
- [Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) · cb21972a
  EdalatiAli authored Mar 02, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  cb21972a