Commits · eb4205fee52dce68f916e1793faec1fa557a014d · OpenDAS / vllm_cscc

09 Apr, 2026 1 commit

[UX] Integrate DeepGEMM into vLLM wheel via CMake (#37980) · eb4205fe

Michael Goin authored Apr 09, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

eb4205fe

08 Apr, 2026 3 commits
- [ROCm] Enable fused_silu_mul_block_quant on ROCm (#38817) · 56c976c1
  Gregory Shtrasberg authored Apr 08, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  56c976c1
- [ROCm][CI-Build] Cherry pick triton BUFFER_OPS fix and update AITER (#38580) · 0e9f0a51
  Gregory Shtrasberg authored Apr 08, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  0e9f0a51
- [release 2.11] Update to torch 2.11 (#34644) · 2111997f
  Andrey Talman authored Apr 07, 2026
  
  2111997f
02 Apr, 2026 1 commit
- Revert "[Kernel] Add gpt-oss Router GEMM kernel (#37205)" (#38778) · 9bd72311
  Xin Yang authored Apr 01, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  9bd72311
01 Apr, 2026 1 commit
- Feature/silu block quant fusion v1 (#32996) · c09ad767
  Monishver authored Apr 01, 2026
```
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
```
  c09ad767
31 Mar, 2026 1 commit
- [4/n] Migrate FP4/W4A8 CUTLASS kernels to torch stable ABI (#37503) · 7c080dd3
  mikaylagawarecki authored Mar 31, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
  7c080dd3
30 Mar, 2026 2 commits
- [3/n] Migrate cutlass/scaled_mm_entry.cu torch stable ABI (#37221) · ab1a6a43
  mikaylagawarecki authored Mar 30, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
  ab1a6a43
- [NVIDIA] Bugfix NVFP4 DGX Spark and RTX50 (#38423) · b4a2f3ac
  Johnny authored Mar 30, 2026
```
Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnynuca14@gmail.com>
```
  b4a2f3ac
27 Mar, 2026 1 commit

[NVIDIA] Fix DGX Spark logic (#38126) · 97d19197

Johnny authored Mar 27, 2026


Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Signed-off-by: Sathish Sanjeevi <sathish.krishnan.p.s@gmail.com>
Signed-off-by: guillaume_guy <guillaume.guy@airbnb.com>
Signed-off-by: Guillaume Guy <guillaume.c.guy@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Sathish Sanjeevi <SKPsanjeevi@users.noreply.github.com>
Co-authored-by: Guillaume Guy <guillaume.c.guy@gmail.com>
Co-authored-by: guillaume_guy <guillaume.guy@airbnb.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

97d19197

25 Mar, 2026 2 commits
- [2/n] Migrate per_token_group_quant to torch stable ABI (#36058) · bf4cc9ed
  mikaylagawarecki authored Mar 25, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
  bf4cc9ed
- [Bugfix] Preserve CUDA arch suffix (a/f) for SM12x — fixes NVFP4 NaN on desktop Blackwell (#37725) · 4a76ad12
  RobTand authored Mar 25, 2026
```
Signed-off-by: Rob Tand <robert.tand@icloud.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
```
  4a76ad12
23 Mar, 2026 1 commit
- [Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799) · 38364a7e
  Kyle Sayers authored Mar 23, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  38364a7e
19 Mar, 2026 1 commit
- [1/n] Migrate permute_cols to libtorch stable ABI (#31509) · 8b10e4fb
  mikaylagawarecki authored Mar 19, 2026
```
Signed-off-by: Mikayla Gawarecki <mikaylagawarecki@gmail.com>
```
  8b10e4fb
18 Mar, 2026 1 commit
- [Kernel] Add gpt-oss Router GEMM kernel (#37205) · b1169d7b
  Xin Yang authored Mar 18, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1169d7b
11 Mar, 2026 1 commit
- [ROCm][CI/Build] Add gfx1152/gfx1153 (Krackan) to HIP supported architectures (#36499) · 24062b70
  Matthias Gehre authored Mar 12, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  24062b70
02 Mar, 2026 1 commit

[Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) · cb21972a

EdalatiAli authored Mar 02, 2026


Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

cb21972a

27 Feb, 2026 1 commit
- [Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
  roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  38c498b8
26 Feb, 2026 1 commit

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

24 Feb, 2026 1 commit
- [Bugfix] Fix DSV3 kernels breaking _C and _moe_C on unsupported arches (#35123) · 3ef9fd0f
  Michael Goin authored Feb 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3ef9fd0f
23 Feb, 2026 1 commit
- [ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302) · 8435b2e0
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  8435b2e0
18 Feb, 2026 1 commit
- [Model Bash] DeepSeek R1 BF16 Min Latency QKV A GEMM (0.5% E2E Speedup) (#34758) · 6874638b
  Robert Shaw authored Feb 18, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  6874638b
10 Feb, 2026 1 commit

[Perf][Kernel] Add faster topKperRow decode kernel for DeepSeek-V3.2 sparse attention (#33680) · afdce12c

Roberto L. Castro authored Feb 10, 2026

Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>

afdce12c

08 Feb, 2026 1 commit
- [Release 2.10] Update to Torch 2.10 - final release (#30525) · f97ca671
  Andrey Talman authored Feb 08, 2026
  
  f97ca671
28 Jan, 2026 1 commit

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

23 Jan, 2026 1 commit
- [Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
  Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4561f139
10 Jan, 2026 1 commit

Fuse RoPE and MLA KV-cache write (#25774) · 80fead8b

PatrykSaffer authored Jan 10, 2026


Signed-off-by: Patryk Saffer <patryk.saffer99@gmail.com>
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai>
Co-authored-by: Patryk Saffer <patryk.saffer99@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

80fead8b

19 Dec, 2025 1 commit
- [MoE Refactor][3/N] Deprecate cutlass block quant fp8 (b200) (#30990) · 83a317f6
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  83a317f6
17 Dec, 2025 1 commit
- 2.9.1 PyTorch release update (#28495) · e06d0bf0
  Andrey Talman authored Dec 17, 2025
  
  e06d0bf0
16 Dec, 2025 1 commit
- [Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901) · ce96857f
  Jinzhen Lin authored Dec 17, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ce96857f
12 Dec, 2025 1 commit

[Bugfix] Fix CMakeLists Environment Variable (#21804) · 91401c7a

吴坎 authored Dec 12, 2025


Signed-off-by: wu-kan <github@wu-kan.com>
Signed-off-by: 吴坎 <github@wu-kan.cn>
Signed-off-by: wu-kan <github@wu-kan.cn>

91401c7a

09 Dec, 2025 2 commits
- [Kernel]Support W4A8 Grouped GEMM on Hopper (#29691) · f6227c22
  czhu-cohere authored Dec 08, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  f6227c22
- Lora MoE Align Improvements (#29257) · ea657f20
  gnovack authored Dec 08, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  ea657f20
29 Nov, 2025 1 commit

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

25 Nov, 2025 2 commits
- [Kernel] Add NVFP4 MoE CUTLASS support for SM120 (#29242) · e5020986
  Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e5020986
- Display warning only when ROCm version is less than Pytorch required version (#29200) · 40a6f53f
  Inoki authored Nov 25, 2025
```
Signed-off-by: Inoki <inoki@inoki.cc>
```
  40a6f53f
20 Nov, 2025 1 commit

[Misc] don't cache `CUTLASS_REVISION` var in CMakeLists.txt (#28518) · edfe8672

Jinzhen Lin authored Nov 20, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

edfe8672

19 Nov, 2025 2 commits

[Build] Add OpenAI triton_kernels (#28788) · 9912b8cc

Varun Sundar Rabindranath authored Nov 18, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

9912b8cc

[NVIDIA] Guard SM100 CUTLASS MoE macro to SM100 builds v2 (#28938) · 49ef847a
Johnny authored Nov 19, 2025
```
Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnynuca14@gmail.com>
```
49ef847a

15 Nov, 2025 1 commit
- [Bugfix] Build hadacore kernels on >SM90 (#28748) · edfe4981
  Michael Goin authored Nov 14, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  edfe4981