Commits · c9a9db0e023a03f7e2c40e43be302fb07512946a · OpenDAS / vllm_cscc

01 Apr, 2026 3 commits
- [Compile] Fix nvfp4 compile warning (#38573) · c9a9db0e
  Wentao Ye authored Apr 01, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c9a9db0e
- [Kernel] Add MXFP8 to Marlin GEMM/MoE and refactor Mxfp8LinearOp (#34664) · db5d0719
  Michael Goin authored Apr 01, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  db5d0719
- [CPU] Support head_size 512 in cpu_attn (#38676) · 36d7f198
  Li, Jiang authored Apr 01, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  36d7f198
31 Mar, 2026 3 commits
- [fix] Remove trtllm ragged mla prefills (#36540) · 598190aa
  Olya Kozlova authored Mar 31, 2026
```
Signed-off-by: Olya Kozlova <okozlova@nvidia.com>
```
  598190aa
- [4/n] Migrate FP4/W4A8 CUTLASS kernels to torch stable ABI (#37503) · 7c080dd3
  mikaylagawarecki authored Mar 31, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
  7c080dd3
- [CPU] Support int8 compute mode in CPU AWQ (#35697) · f09daea2
  Yintong Lu authored Mar 31, 2026
```
Signed-off-by: Yintong Lu <yintong.lu@intel.com>
```
  f09daea2
30 Mar, 2026 3 commits

[Bugfix] Use null block (0) for padded block table entries (#35431) · bcc6f674

SandishKumarHN authored Mar 30, 2026


Signed-off-by: SandishKumarHN <sandish@fb.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

bcc6f674

[3/n] Migrate cutlass/scaled_mm_entry.cu torch stable ABI (#37221) · ab1a6a43
mikaylagawarecki authored Mar 30, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
ab1a6a43

[NVIDIA] Bugfix NVFP4 DGX Spark and RTX50 (#38423) · b4a2f3ac

Johnny authored Mar 30, 2026


Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnynuca14@gmail.com>

b4a2f3ac

27 Mar, 2026 1 commit
- [Bugfix]fix output Nan/Inf in marlin if dtype=float16 (#33972) · 148a5c12
  IriKa authored Mar 28, 2026
```
Signed-off-by: IriKa Qiu <qiujie.jq@gmail.com>
```
  148a5c12
25 Mar, 2026 2 commits
- [2/n] Migrate per_token_group_quant to torch stable ABI (#36058) · bf4cc9ed
  mikaylagawarecki authored Mar 25, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
  bf4cc9ed
- [Kernel] Optimize SM120 CUTLASS blockwise FP8 GEMM (#37970) · e7221180
  Necofish authored Mar 25, 2026
```
Signed-off-by: Necofish <liuxiangyang@mail.ustc.edu.cn>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  e7221180
24 Mar, 2026 1 commit
- [Bugfix] Add replacement of _compute_slot_mapping_kernel on CPU (#37987) · 352b90c4
  Li, Jiang authored Mar 24, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  352b90c4
23 Mar, 2026 2 commits
- [Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799) · 38364a7e
  Kyle Sayers authored Mar 23, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  38364a7e
- [ROCm] fix sleep mode not releasing GPU memory problem on ROCm (#37533) · 10a1018c
  Zhaodong Bing authored Mar 23, 2026
```
Signed-off-by: bingzhaodong <aaab8b@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  10a1018c
20 Mar, 2026 1 commit
- [ROCm] Enable wvSplitK skinny GEMM kernel for RDNA4/gfx1x decode (#34709) · 1779c098
  L.B.R. authored Mar 20, 2026
```
Signed-off-by: L.B.R. <lbr@mmonad.com>
Co-authored-by: L.B.R. <lbr@mmonad.com>
```
  1779c098
19 Mar, 2026 2 commits
- [1/n] Migrate permute_cols to libtorch stable ABI (#31509) · 8b10e4fb
  mikaylagawarecki authored Mar 19, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
  8b10e4fb
- fix(cpu): add null check for aligned_alloc in ScratchPadManager (#37369) · 199f9141
  yassha authored Mar 19, 2026
```
Signed-off-by: yassha <50112520+yassha@users.noreply.github.com>
```
  199f9141
18 Mar, 2026 1 commit
- [Kernel] Add gpt-oss Router GEMM kernel (#37205) · b1169d7b
  Xin Yang authored Mar 18, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1169d7b
17 Mar, 2026 1 commit
- [Kernel] Add non-gated support for NVFP4 CUTLASS MoE (#37320) · 09e4576f
  Michael Goin authored Mar 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  09e4576f
16 Mar, 2026 6 commits
- [Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · 3e6a1e16
  Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
  3e6a1e16
- [Bugfix] opcheck false mutation error in rms_norm_per_block_quant (#36688) (#36779) · c0f01191
  Krish Gupta authored Mar 17, 2026
```
Signed-off-by: Krish Gupta <krishom70@gmail.com>
```
  c0f01191
- [MTP][Sparse MLA] Take advantage of native MTP support in indexer when possible (#36982) · c88ea833
  Matthew Bonanni authored Mar 16, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  c88ea833
- [Compile] Fix compile warning `st256_cs` in `cuda_vec_utils.cuh` (#36693) · ce8cf916
  Wentao Ye authored Mar 16, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ce8cf916
- [BUGFIX]fix CUDA OOM ERROR : invalid argument at cumem_allocator.cpp:119 (#35594) · 18be11fd
  xjx authored Mar 16, 2026
```
Signed-off-by: xjx <493337577@qq.com>
```
  18be11fd
- [Compile] Fix compile warning in `moe_permute` (#36529) · e855d380
  Wentao Ye authored Mar 16, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e855d380
11 Mar, 2026 3 commits

[torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551) · 9556af87

Luka Govedič authored Mar 11, 2026

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>

9556af87

Add 320 dimension size support to MLA (#36161) · a5d06dc5
Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
a5d06dc5
feat: add RISC-V support for CPU backend (v2) (#36578) · 41846537
typer-J authored Mar 11, 2026
```
Signed-off-by: typer-J <2236066784@qq.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
41846537

10 Mar, 2026 1 commit
- Improvements to wvSplitKrc skinny GEMM solution (#34304) · 721ae79f
  Hashem Hashemi authored Mar 10, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  721ae79f
09 Mar, 2026 2 commits

[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA... · 580864d8

Roberto L. Castro authored Mar 09, 2026


[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>

580864d8

[Attention][Perf] Optimize cp_gather_and_upconvert_fp8_kv_cache - DeepSeek-v3.2 (#35290) · 2b28b9b2
Roberto L. Castro authored Mar 09, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
2b28b9b2

05 Mar, 2026 2 commits

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

[Perf] Use dummy M for weight prepacking on x86 (#35890) · 8e782013
Tianmu Li authored Mar 04, 2026
```
Signed-off-by: Li, Tianmu <tianmu.li@intel.com>
```
8e782013

02 Mar, 2026 1 commit

[Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) · cb21972a

EdalatiAli authored Mar 02, 2026


Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

cb21972a

01 Mar, 2026 1 commit
- [Mamba1] - Kernel Level Chunk Alignment for Prefix Caching (#34798) · bbf81f9a
  Asaf Gardin authored Mar 01, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  bbf81f9a
28 Feb, 2026 3 commits

Add padding support to wvSplitK solution for skinny GEMMs (#33762) · 7600642e
Hashem Hashemi authored Feb 28, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
7600642e
[CI/Build] CPU release supports both of AVX2 and AVX512 (#35466) · 90805ff4
Ma Jian authored Feb 28, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
```
90805ff4

[Refactor][Kernel] Add global helper to deduplicate vectorized memory ops (#35105) · a201ad72

Roberto L. Castro authored Feb 28, 2026

Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>

a201ad72

27 Feb, 2026 1 commit
- [Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
  roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  38c498b8