Commits · 4f8f47e87e4f65195cf77b0de93feb63fc5a5b2f · OpenDAS / vllm_cscc

03 Oct, 2025 1 commit

Fix undefined symbol: cutlass_moe_mm_sm100 (#26098) · 4f8f47e8

Jun Jiang authored Oct 03, 2025


Signed-off-by: Jun Jiang <jasl9187@hotmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

4f8f47e8

01 Oct, 2025 2 commits

[NVIDIA] Blackwell Family (#24673) · 5234dc74

Johnny authored Oct 01, 2025


Signed-off-by: Johnny <johnnynuca14@gmail.com>
Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnync13@gmail.com>
Signed-off-by: Salvatore Cena <cena@cenas.it>
Co-authored-by: Aidyn-A <31858918+Aidyn-A@users.noreply.github.com>
Co-authored-by: Salvatore Cena <cena@cenas.it>

5234dc74

Fix INT8 quantization error on Blackwell GPUs (SM100+) (#25935) · 99028fda
Param authored Sep 30, 2025
```
Signed-off-by: padg9912 <phone.and.desktop@gmail.com>
```
99028fda

15 Sep, 2025 1 commit
- [Bug] Fix Cutlass Scaled MM Compilation Error (#24887) · e757a629
  Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e757a629
11 Sep, 2025 1 commit

[Perf] Use upstream CUTLASS for SM90 Block FP8 kernel (#23280) · c3aea10d

Michael Goin authored Sep 11, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

c3aea10d

20 Aug, 2025 1 commit
- [Kernel] CUTLASS MoE FP8: Integrate cuda moe permute/unpermute (#23045) · b17109be
  shixianc authored Aug 20, 2025
```
Signed-off-by: Shixian Cui <shixian@amazon.com>
```
  b17109be
15 Aug, 2025 1 commit
- [Fix] enable swap_ab for pplx problem size computation (#22991) · 7f89ed24
  shixianc authored Aug 15, 2025
```
Signed-off-by: Shixian Cui <shixian@amazon.com>
Co-authored-by: Shixian Cui <shixian@amazon.com>
```
  7f89ed24
08 Aug, 2025 1 commit
- [Kernel] Add support for block FP8 on SM120 (NVIDIA 5090 and RTX PRO 6000) (#22131) · 3303f134
  Junhao Li authored Aug 07, 2025
```
Signed-off-by: Junhao Li <junhao@ubicloud.com>
```
  3303f134
30 Jul, 2025 1 commit
- [Docs] Switch to better markdown linting pre-commit hook (#21851) · ba5c5e54
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ba5c5e54
28 Jul, 2025 1 commit
- [Kernel] SM90 CUTLASS FP8 GEMM: add support for swap AB + kernel tuning (#20396) · c6c9122d
  lyrisz authored Jul 28, 2025
```
Signed-off-by: Faqin Zhong <faqin.zhong@gmail.com>
Co-authored-by: Duncan Moss <djm.moss@gmail.com>
```
  c6c9122d
24 Jul, 2025 1 commit
- [Bug] Fix Compressed Tensor NVFP4 `cutlass_fp4_group_mm` illegal memory access (#21465) · e8cb0d04
  Wentao Ye authored Jul 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e8cb0d04
22 Jul, 2025 1 commit

[feat]: add SM100 support for cutlass FP8 groupGEMM (#20447) · 2c8db17c

Duncan Moss authored Jul 22, 2025


Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

2c8db17c

18 Jul, 2025 1 commit
- [Perf] Add swap_ab to SM90 FP8 non-block CUTLASS moe grouped gemm (#20911) · 5780121c
  shixianc authored Jul 17, 2025
```
Signed-off-by: Shixian Cui <shixian@amazon.com>
Co-authored-by: Shixian Cui <shixian@amazon.com>
```
  5780121c
11 Jul, 2025 1 commit
- [fix]: disable cutlass block scaled group gemm for EP (#20781) · 5923ab95
  Duncan Moss authored Jul 10, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
```
  5923ab95
08 Jul, 2025 1 commit
- [Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE (#20166) · c438183e
  Ming Yang authored Jul 08, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
```
  c438183e
06 Jul, 2025 1 commit
- [BugFix] Fix: ImportError when building on hopper systems (#20513) · 40b86aa0
  Lucas Wilkinson authored Jul 06, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  40b86aa0
04 Jul, 2025 1 commit
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95
02 Jul, 2025 1 commit
- [NVIDIA] Support Cutlass w8a8 FP8 for Blackwell Geforce GPUs (sm120) (#17280) · 9e5552aa
  Joonchen Liau authored Jul 02, 2025
```
Signed-off-by: kaln27 <liaojuncheng123@foxmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  9e5552aa
27 Jun, 2025 2 commits
- [Bugfix] Build moe_data for both sm100 and sm90 (#20086) · 44d2e6af
  Michael Goin authored Jun 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  44d2e6af
- [Perf] SM100 FP8 GEMM Optimizations after cutlass_profiler (#20071) · 2d7779f8
  Ilya Markov authored Jun 27, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  2d7779f8
15 Jun, 2025 1 commit
- [Perf] Further tunings for SM100 FP8 CUTLASS kernel (#19566) · e13945f9
  Ilya Markov authored Jun 15, 2025
  
  e13945f9
07 Jun, 2025 1 commit

[Kernel] Integrate CUTLASS MoE kernel with PPLX (#18762) · 84166fee

ElizaWszola authored Jun 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

84166fee

05 Jun, 2025 1 commit
- [Hardware][NVIDIA] FP4 MoE kernel optimization (#19110) · 61059bee
  Chiyue Wei authored Jun 05, 2025
```
Signed-off-by: Chiyue Wei <chiyuew@nvidia.com>
Co-authored-by: Chiyue Wei <chiyuew@nvidia.com>
```
  61059bee
04 Jun, 2025 2 commits
- [Perf] Tunings for SM100 FP8 CUTLASS kernel (#18778) · 53a5a0ce
  Michael Goin authored Jun 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  53a5a0ce
- Sm100 blockwise fp8 swap ab (#18564) · 5f2cd251
  Lain authored Jun 04, 2025
  
  5f2cd251
22 May, 2025 1 commit

[Build/CI] Fix CUDA 11.8 build (#17679) · 6e588da0

Tyler Michael Smith authored May 22, 2025


Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>

6e588da0

16 May, 2025 1 commit
- use ceil_div in cutlass block scaling shape check (#17918) · e23564cb
  Lain authored May 16, 2025
  
  e23564cb
13 May, 2025 1 commit
- Fix Broken macro for cutlass moe (#18049) · e57e4d6e
  Driss Guessous authored May 12, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  e57e4d6e
09 May, 2025 1 commit
- [Hardware/NVIDIA/Kernel] Enable nvidia/DeepSeek-R1-FP4 Model (#16362) · 0c0fdae8
  Pavani Majety authored May 09, 2025
  
  0c0fdae8
08 May, 2025 1 commit
- Add cutlass support for blackwell fp8 blockwise gemm (#14383) · 376786fa
  Shu Wang authored May 08, 2025
```
Signed-off-by: Shu Wang <shuw@nvidia.com>
```
  376786fa
28 Apr, 2025 1 commit
- [Bugfix] Fix cutlass dispatch for fp8/int8 to properly invoke M<=16 c… (#16751) · c12df53b
  TherLF authored Apr 28, 2025
```
Signed-off-by: Ther-LF <2639852836@qq.com>
```
  c12df53b
22 Apr, 2025 1 commit

[Kernel] Add expert_map support to Cutlass FP8 MOE (#16861) · 7b8a2ab7

Varun Sundar Rabindranath authored Apr 21, 2025


Signed-off-by: varun sundar rabindranath <vsundarr@redhat.com>
Co-authored-by: varun sundar rabindranath <vsundarr@redhat.com>

7b8a2ab7

27 Mar, 2025 1 commit

[Kernel] CUTLASS grouped gemm fp8 MoE kernel (#13972) · 9239bf71

ElizaWszola authored Mar 27, 2025


Signed-off-by: ElizaWszola <eliza@neuralmagic.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Lucas Wilkinson <wilkinson.lucas@gmail.com>

9239bf71

08 Mar, 2025 1 commit

[Build/BugFix] Fix hopper 12.8 build (#14354) · 7caff01a

Lucas Wilkinson authored Mar 08, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

7caff01a

04 Mar, 2025 1 commit
- add cutlass support for blackwell fp8 gemm (#13798) · f89978ad
  kushanam authored Mar 04, 2025
  
  f89978ad
21 Feb, 2025 2 commits

[Attention] MLA with chunked prefill (#12639) · 288cc6c2

Lucas Wilkinson authored Feb 21, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Patrick Horn <patrick.horn@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

288cc6c2

[Kernel]Add streamK for block-quantized CUTLASS kernels (#12978) · 839b27c6
leoneo authored Feb 21, 2025

839b27c6

14 Feb, 2025 1 commit
- [Kernel][Bugfix] Refactor and Fix CUTLASS 2:4 Sparse Kernels (#13198) · c1e37bf7
  Tyler Michael Smith authored Feb 13, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  c1e37bf7
08 Feb, 2025 1 commit
- [CI/Build] Auto-fix Markdown files (#12941) · 8a69e0e2
  Cyrus Leung authored Feb 08, 2025
  
  8a69e0e2
03 Feb, 2025 1 commit
- [Bugfix][Kernel] Fix per-token/per-channel quantization for Hopper scaled mm (#12696) · c11de33d
  Tyler Michael Smith authored Feb 03, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  c11de33d