Commits · 352b90c4a4f2af1d75cdc09fecf30a47a4ca39fb · OpenDAS / vllm_cscc

24 Mar, 2026 1 commit
- [Bugfix] Add replacement of _compute_slot_mapping_kernel on CPU (#37987) · 352b90c4
  Li, Jiang authored Mar 24, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  352b90c4
23 Mar, 2026 2 commits
- [Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799) · 38364a7e
  Kyle Sayers authored Mar 23, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  38364a7e
- [ROCm] fix sleep mode not releasing GPU memory problem on ROCm (#37533) · 10a1018c
  Zhaodong Bing authored Mar 23, 2026
```
Signed-off-by: bingzhaodong <aaab8b@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  10a1018c
20 Mar, 2026 1 commit
- [ROCm] Enable wvSplitK skinny GEMM kernel for RDNA4/gfx1x decode (#34709) · 1779c098
  L.B.R. authored Mar 20, 2026
```
Signed-off-by: L.B.R. <lbr@mmonad.com>
Co-authored-by: L.B.R. <lbr@mmonad.com>
```
  1779c098
19 Mar, 2026 2 commits
- [1/n] Migrate permute_cols to libtorch stable ABI (#31509) · 8b10e4fb
  mikaylagawarecki authored Mar 19, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
  8b10e4fb
- fix(cpu): add null check for aligned_alloc in ScratchPadManager (#37369) · 199f9141
  yassha authored Mar 19, 2026
```
Signed-off-by: yassha <50112520+yassha@users.noreply.github.com>
```
  199f9141
18 Mar, 2026 1 commit
- [Kernel] Add gpt-oss Router GEMM kernel (#37205) · b1169d7b
  Xin Yang authored Mar 18, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1169d7b
17 Mar, 2026 1 commit
- [Kernel] Add non-gated support for NVFP4 CUTLASS MoE (#37320) · 09e4576f
  Michael Goin authored Mar 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  09e4576f
16 Mar, 2026 6 commits
- [Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · 3e6a1e16
  Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
  3e6a1e16
- [Bugfix] opcheck false mutation error in rms_norm_per_block_quant (#36688) (#36779) · c0f01191
  Krish Gupta authored Mar 17, 2026
```
Signed-off-by: Krish Gupta <krishom70@gmail.com>
```
  c0f01191
- [MTP][Sparse MLA] Take advantage of native MTP support in indexer when possible (#36982) · c88ea833
  Matthew Bonanni authored Mar 16, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  c88ea833
- [Compile] Fix compile warning `st256_cs` in `cuda_vec_utils.cuh` (#36693) · ce8cf916
  Wentao Ye authored Mar 16, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ce8cf916
- [BUGFIX]fix CUDA OOM ERROR : invalid argument at cumem_allocator.cpp:119 (#35594) · 18be11fd
  xjx authored Mar 16, 2026
```
Signed-off-by: xjx <493337577@qq.com>
```
  18be11fd
- [Compile] Fix compile warning in `moe_permute` (#36529) · e855d380
  Wentao Ye authored Mar 16, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e855d380
11 Mar, 2026 3 commits

[torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551) · 9556af87

Luka Govedič authored Mar 11, 2026

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>

9556af87

Add 320 dimension size support to MLA (#36161) · a5d06dc5
Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
a5d06dc5
feat: add RISC-V support for CPU backend (v2) (#36578) · 41846537
typer-J authored Mar 11, 2026
```
Signed-off-by: typer-J <2236066784@qq.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
41846537

10 Mar, 2026 1 commit
- Improvements to wvSplitKrc skinny GEMM solution (#34304) · 721ae79f
  Hashem Hashemi authored Mar 10, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  721ae79f
09 Mar, 2026 2 commits

[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA... · 580864d8

Roberto L. Castro authored Mar 09, 2026


[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>

580864d8

[Attention][Perf] Optimize cp_gather_and_upconvert_fp8_kv_cache - DeepSeek-v3.2 (#35290) · 2b28b9b2
Roberto L. Castro authored Mar 09, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
2b28b9b2

05 Mar, 2026 2 commits

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

[Perf] Use dummy M for weight prepacking on x86 (#35890) · 8e782013
Tianmu Li authored Mar 04, 2026
```
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
```
8e782013

02 Mar, 2026 1 commit

[Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) · cb21972a

EdalatiAli authored Mar 02, 2026


Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

cb21972a

01 Mar, 2026 1 commit
- [Mamba1] - Kernel Level Chunk Alignment for Prefix Caching (#34798) · bbf81f9a
  Asaf Gardin authored Mar 01, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  bbf81f9a
28 Feb, 2026 3 commits

Add padding support to wvSplitK solution for skinny GEMMs (#33762) · 7600642e
Hashem Hashemi authored Feb 28, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
7600642e
[CI/Build] CPU release supports both of AVX2 and AVX512 (#35466) · 90805ff4
Ma Jian authored Feb 28, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
```
90805ff4

[Refactor][Kernel] Add global helper to deduplicate vectorized memory ops (#35105) · a201ad72

Roberto L. Castro authored Feb 28, 2026

Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>

a201ad72

27 Feb, 2026 1 commit
- [Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
  roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  38c498b8
26 Feb, 2026 3 commits
- [WideEP] Remove pplx all2all backend (#33724) · eb19955c
  Tyler Michael Smith authored Feb 26, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  eb19955c
- [Bugfix] Fix uint32 overflow in Mamba selective scan state pointer arithmetic (#35275) · ec13e549
  Asaf Gardin authored Feb 26, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  ec13e549
- [BugFix] Fix fp4 quant kernel on CUDA 12.8 (#35210) · 86c3b5a8
  Roberto L. Castro authored Feb 26, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  86c3b5a8
25 Feb, 2026 2 commits
- [Perf] Optimize FP8 gemm of sm120. (#34424) · cd436736
  wenshuai authored Feb 25, 2026
```
Signed-off-by: wenshuai <wenshuai@xiaomi.com>
```
  cd436736
- [Bugfix] Fix expert_ids padding values in moe_align_block_size kernel (#35161) · 3bbb2046
  Xin Yang authored Feb 24, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  3bbb2046
24 Feb, 2026 3 commits
- Convert wvSplitKQ to 16x16 MFMA in prep for mi4xx. (#34100) · a0e50a42
  Hashem Hashemi authored Feb 24, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  a0e50a42
- [CPU][Perf] Accelerate Attention head for s390x using vector intrinsics (#34434) · 34ce0ffd
  R3hankhan authored Feb 24, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  34ce0ffd
- [Bugfix] Fix DSV3 kernels breaking _C and _moe_C on unsupported arches (#35123) · 3ef9fd0f
  Michael Goin authored Feb 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3ef9fd0f
23 Feb, 2026 1 commit
- [ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302) · 8435b2e0
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  8435b2e0
21 Feb, 2026 1 commit

[Bugfix] Gate 256-bit instructions to CUDA 12.9+ (#34791) · 272b535a

Huy Do authored Feb 21, 2026


Signed-off-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

272b535a

20 Feb, 2026 1 commit
- [Kernel] Optimize grouped topk kernel (#34206) · b1c4f0b2
  Xin Yang authored Feb 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1c4f0b2
18 Feb, 2026 1 commit
- [Model Bash] DeepSeek R1 BF16 Min Latency QKV A GEMM (0.5% E2E Speedup) (#34758) · 6874638b
  Robert Shaw authored Feb 18, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  6874638b