Commits · 6a895197fafa7069be75ff615709b77546bcec30 · OpenDAS / vllm_cscc

05 Mar, 2026 3 commits
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [ROCm] Refactor ROCm attention backend selection logic (#35246) · 8c760b6a
  Sage Moore authored Mar 05, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  8c760b6a
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
04 Mar, 2026 3 commits
- [CI] Bump `mypy` version (#34950) · 17dc9c7f
  Harry Mellor authored Mar 04, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  17dc9c7f
- [Misc] Add `--attention-backend auto` option (#35738) · 18e01a0a
  Nicolò Lucchesi authored Mar 04, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  18e01a0a
- [Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d
  Kunshang Ji authored Mar 04, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  16d2ad1d
03 Mar, 2026 2 commits

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

TRTLLM gen-full attn Test Coverage (#34986) · e05cb3b9

ojhaanshika authored Mar 03, 2026


Signed-off-by: Anshika Ojha <anshikao@nvidia.com>
Co-authored-by: Anshika Ojha <anshikao@gb-nvl-059-compute09.nvidia.com>

e05cb3b9

02 Mar, 2026 2 commits
- [Core] Move test utility to test file (#35672) · 4034c3d3
  Turner Jabbour authored Mar 02, 2026
```
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
```
  4034c3d3
- [Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) · cb21972a
  EdalatiAli authored Mar 02, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  cb21972a
01 Mar, 2026 2 commits
- [Bugfix] Fix dtype mismatch in RMSNormGated.forward_native() during torch.compile (#35256) · 62904708
  haosdent authored Mar 02, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  62904708
- [Mamba1] - Kernel Level Chunk Alignment for Prefix Caching (#34798) · bbf81f9a
  Asaf Gardin authored Mar 01, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  bbf81f9a
28 Feb, 2026 2 commits

Add padding support to wvSplitK solution for skinny GEMMs (#33762) · 7600642e
Hashem Hashemi authored Feb 28, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
7600642e

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

27 Feb, 2026 4 commits
- [Kernel] [Helion] [7/N] Use HOP to represent Helion Kernel call to enable fx... · 9098ce69
  Yanan Cao authored Feb 27, 2026
```
[Kernel] [Helion] [7/N] Use HOP to represent Helion Kernel call to enable fx tracing and pattern matching (#34390)
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  9098ce69
- Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580) · 9c3fe993
  Max Hu authored Feb 27, 2026
```
Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>
```
  9c3fe993
- [CI] Actually run tests/kernels/quantization/test_block_fp8.py in CI (#34274) · 4fec53cf
  Michael Goin authored Feb 26, 2026
  
  4fec53cf
- [Update] Use FlashInfer fast_decode_plan directly instead of replication (#34687) · 56a63717
  Andrii Skliar authored Feb 27, 2026
```
Signed-off-by: Andrii <askliar@nvidia.com>
Co-authored-by: Andrii <askliar@nvidia.com>
```
  56a63717
26 Feb, 2026 1 commit

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

25 Feb, 2026 3 commits
- fix(mxfp4): Disable monolithic path for TRITON backend with EP (#34270) · c97234c0
  Elizabeth Thomas authored Feb 25, 2026
```
Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  c97234c0
- [Platform] Add current_platform.num_compute_units interface (#35042) · 8ad54a99
  Kunshang Ji authored Feb 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  8ad54a99
- [Bugfix] Fix expert_ids padding values in moe_align_block_size kernel (#35161) · 3bbb2046
  Xin Yang authored Feb 24, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  3bbb2046
24 Feb, 2026 2 commits

[Attn,KV-cache] Use per-head scales in the attention selector (#34281) · a87cc508

Eldar Kurtić authored Feb 24, 2026


Signed-off-by: Your Name <you@example.com>
Signed-off-by: Eldar Kurtic <research@neuralmagic.com>
Co-authored-by: Eldar Kurtic <research@neuralmagic.com>
Co-authored-by: Your Name <you@example.com>

a87cc508

[Refactor] [1/N] Reorganize kernel abstraction directory (#34055) · 6af03f23

BadrBasowid authored Feb 24, 2026


Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

6af03f23

22 Feb, 2026 1 commit

[Model] Add NVFP4 quantization support for Step3.5-Flash (#34478) · b7892a3b

tacos8me authored Feb 22, 2026


Signed-off-by: tacos8me <ian@cloudhabit.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

b7892a3b

21 Feb, 2026 1 commit
- [Kernel] [Helion] [9/N] Canonicalize GPU variant names to base model names (#34928) · 9d7577b2
  Yanan Cao authored Feb 20, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  9d7577b2
20 Feb, 2026 2 commits
- [Kernel] [Helion] [6/N] Add num_tokens dimension to silu_mul autotuning and dispatching (#34185) · a6d0299c
  Yanan Cao authored Feb 20, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  a6d0299c
- [Kernel] Optimize grouped topk kernel (#34206) · b1c4f0b2
  Xin Yang authored Feb 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1c4f0b2
18 Feb, 2026 5 commits

[CI][AMD][BugFix] Use torch.testing.assert_close instead of assert... · 2b84ac66

rasmith authored Feb 18, 2026


[CI][AMD][BugFix] Use torch.testing.assert_close instead of assert torch.allclose in test_rocm_skinny_gemms.py (#34181)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

2b84ac66

[Bugfix][MoE Kernel] Fix incorrect routing selection for models without expert... · 847a57cd

Wenlong Wang authored Feb 18, 2026


[Bugfix][MoE Kernel] Fix incorrect routing selection for models without expert groups (e.g., MiniMax-M2.1) (#34673)
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

847a57cd

[CI][AMD][BugFix] Skip tests in test_unquantized_backend_selection that should... · fcd6ac97

rasmith authored Feb 18, 2026


[CI][AMD][BugFix] Skip tests in test_unquantized_backend_selection that should not run on ROCm (#34655)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

fcd6ac97

Add unit tests for fp8 output fusion of triton_attn (#34228) · e24663c5

Burkhard Ringlein authored Feb 18, 2026


Signed-off-by: Burkhard Ringlein <ngl@zurich.ibm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

e24663c5

[Bugfix] Fix quant RMS norm fusion for quantization with TMA-aligned scales (#33255) · a88b3be7
ElizaWszola authored Feb 18, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
a88b3be7

17 Feb, 2026 1 commit
- [Bugfix] Fix fused MoE int32 overflow in stride*offset without perf regression (#34507) · b68fd899
  haosdent authored Feb 17, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  b68fd899
15 Feb, 2026 2 commits
- [MM Encoder] Add Triton ViT attention backend (#32183) · 71cd8926
  Isotr0py authored Feb 15, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  71cd8926
- [Bugfix] Handle num_expert_group=None in flashinfer block-scale FP8 MoE (#34494) · 79f3fab0
  haosdent authored Feb 15, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  79f3fab0
13 Feb, 2026 3 commits
- [Bugfix] fix the import path in moe test utils.py (#34245) · 742d214d
  Marek Michalowski authored Feb 13, 2026
```
Signed-off-by: Marek Michalowski <marek.michalowski@arm.com>
```
  742d214d
- [Bugfix] Standardize getting number of image patches/tokens (#34358) · 372b2e76
  Cyrus Leung authored Feb 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  372b2e76
- [Kernel] [Helion] [4/N] Add silu_mul_fp8 Helion kernel (#33373) · 96161fe9
  Yanan Cao authored Feb 12, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
```
  96161fe9
12 Feb, 2026 1 commit
- [Kernel] Support Flashinfer trtllm fused MoE non gated FP8 & NVFP4 (#33506) · f120bd42
  amitz-nv authored Feb 12, 2026
```
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>
```
  f120bd42