Commits · 148a5c1226f8668cb52c4900b5ff2c80344e78f2 · OpenDAS / vllm_cscc

27 Mar, 2026 1 commit
- [Bugfix]fix output Nan/Inf in marlin if dtype=float16 (#33972) · 148a5c12
  IriKa authored Mar 28, 2026
```
Signed-off-by: IriKa Qiu <qiujie.jq@gmail.com>
```
  148a5c12
25 Mar, 2026 2 commits
- [2/n] Migrate per_token_group_quant to torch stable ABI (#36058) · bf4cc9ed
  mikaylagawarecki authored Mar 25, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
  bf4cc9ed
- [Kernel] Optimize SM120 CUTLASS blockwise FP8 GEMM (#37970) · e7221180
  Necofish authored Mar 25, 2026
```
Signed-off-by: Necofish <liuxiangyang@mail.ustc.edu.cn>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  e7221180
17 Mar, 2026 1 commit
- [Kernel] Add non-gated support for NVFP4 CUTLASS MoE (#37320) · 09e4576f
  Michael Goin authored Mar 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  09e4576f
16 Mar, 2026 2 commits
- [Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · 3e6a1e16
  Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
  3e6a1e16
- [Bugfix] opcheck false mutation error in rms_norm_per_block_quant (#36688) (#36779) · c0f01191
  Krish Gupta authored Mar 17, 2026
```
Signed-off-by: Krish Gupta <krishom70@gmail.com>
```
  c0f01191
11 Mar, 2026 1 commit

[torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551) · 9556af87

Luka Govedič authored Mar 11, 2026

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>

9556af87

05 Mar, 2026 1 commit

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

28 Feb, 2026 1 commit

[Refactor][Kernel] Add global helper to deduplicate vectorized memory ops (#35105) · a201ad72

Roberto L. Castro authored Feb 28, 2026

Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>

a201ad72

26 Feb, 2026 2 commits
- [WideEP] Remove pplx all2all backend (#33724) · eb19955c
  Tyler Michael Smith authored Feb 26, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  eb19955c
- [BugFix] Fix fp4 quant kernel on CUDA 12.8 (#35210) · 86c3b5a8
  Roberto L. Castro authored Feb 26, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  86c3b5a8
25 Feb, 2026 1 commit
- [Perf] Optimize FP8 gemm of sm120. (#34424) · cd436736
  wenshuai authored Feb 25, 2026
```
Signed-off-by: wenshuai <wenshuai@xiaomi.com>
```
  cd436736
18 Feb, 2026 1 commit
- [Bugfix] Fix quant RMS norm fusion for quantization with TMA-aligned scales (#33255) · a88b3be7
  ElizaWszola authored Feb 18, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  a88b3be7
07 Feb, 2026 1 commit
- [Kernel] Add enable_sm120_or_later for SM121 (DGX Spark) CUTLASS support (#33517) · bc32444b
  Vel authored Feb 06, 2026
```
Signed-off-by: code4me2 <velvetmoon222999@gmail.com>
```
  bc32444b
02 Feb, 2026 1 commit

fix cutlass_3x_gemm_fp8_blockwise on sm103a (#32224) · 089cd4f0

Lain authored Feb 02, 2026


Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>

089cd4f0

28 Jan, 2026 2 commits

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2eb673a0

25 Jan, 2026 1 commit
- [Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
  Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  fcb9df99
23 Jan, 2026 1 commit
- [Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
  Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4561f139
21 Jan, 2026 1 commit

[Quantization][Deprecation] Deprecate HQQ (#32681) · 85f55c94

Robert Shaw authored Jan 21, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

85f55c94

18 Jan, 2026 1 commit
- [Refactor] Remove unused cutlass moe problem size function (#32047) · eebc58df
  Wentao Ye authored Jan 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eebc58df
09 Jan, 2026 3 commits

[Quant] Make static quant support all group shapes (#30833) · 0a0aa077
Lucas Wilkinson authored Jan 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
0a0aa077

[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput... · 308feab3

Wentao Ye authored Jan 09, 2026


[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput improvement, 2.2% TTFT improvement (#31830)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

308feab3

[Perf][Kernel] Fused SiLU+Mul+Quant kernel for NVFP4 cutlass_moe (#31832) · 34cd32fe
Michael Goin authored Jan 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
34cd32fe

07 Jan, 2026 1 commit
- [Perf] Fuse stride preparation for NVFP4 cutlass_moe (#31837) · f347ac6c
  Michael Goin authored Jan 07, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f347ac6c
29 Dec, 2025 1 commit
- [ROCm][GPTQ][Bugfix] Fix GPTQ GEMM kernel output zeroing race condition (#30719) · 3ecfdc37
  Andreas Karatzas authored Dec 29, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  3ecfdc37
23 Dec, 2025 1 commit

[FIX] FP4 quantization kernel padding initialization bug (#31097) · b94f80ff

danielafrimi authored Dec 23, 2025



Signed-off-by: <>
Co-authored-by: root <root@gpu-193.slurm-workers-slurm.slurm.svc.cluster.local>
Co-authored-by: root <root@gpu-951.slurm-workers-slurm.slurm.svc.cluster.local>

b94f80ff

21 Dec, 2025 1 commit
- [NVFP4][Perf] Tune NVFP4 input quant kernel for small batch size (#30897) · 06d49028
  Michael Goin authored Dec 21, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  06d49028
19 Dec, 2025 1 commit
- [MoE Refactor][3/N] Deprecate cutlass block quant fp8 (b200) (#30990) · 83a317f6
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  83a317f6
16 Dec, 2025 1 commit
- [Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901) · ce96857f
  Jinzhen Lin authored Dec 17, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ce96857f
12 Dec, 2025 1 commit
- [Refactor] Reduce duplicate code in `per_token_group_quant` cuda kernels (#30496) · 1e6b1153
  Wentao Ye authored Dec 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1e6b1153
10 Dec, 2025 1 commit

Fix typos in comments across multiple files (#30345) · 3bdd4266

Wilson Wu authored Dec 10, 2025


Signed-off-by: Wilson Wu <iwilsonwu@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

3bdd4266

09 Dec, 2025 1 commit
- [Kernel]Support W4A8 Grouped GEMM on Hopper (#29691) · f6227c22
  czhu-cohere authored Dec 08, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  f6227c22
07 Dec, 2025 2 commits

[Performance] Fused blockwise quant RMS norm (#27883) · af0444bf

ElizaWszola authored Dec 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>

af0444bf

[Perf] Deepgemm fused layout kernel for activations, 4.3% throughput... · 541a2ef8

Wentao Ye authored Dec 07, 2025


[Perf] Deepgemm fused layout kernel for activations, 4.3% throughput improvement, 10.7% TTFT improvement. (#29546)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

541a2ef8

02 Dec, 2025 1 commit
- SM120 / NVFP4: add device guard and runtime SM dispatch to cutlass_scaled_fp4_mm (#29711) · c0dfc894
  Hendrik Holtmann authored Dec 02, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  c0dfc894
29 Nov, 2025 1 commit

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

25 Nov, 2025 1 commit
- [Kernel] Add NVFP4 MoE CUTLASS support for SM120 (#29242) · e5020986
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e5020986
15 Nov, 2025 1 commit
- Use narrow over indexing in `hadacore_transform` to prep for ABI stable (#28756) · 74b5267d
  Jane (Yuan) Xu authored Nov 15, 2025
```
Signed-off-by: Jane Xu <janeyx@meta.com>
```
  74b5267d
14 Nov, 2025 1 commit
- [kernel] Improve FP8 PTPC on Hopper for larger shapes (#28692) · cdd70259
  czhu-cohere authored Nov 14, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  cdd70259