Commits · 2ded067fd247d3f95938970fcc8f2982d019f1a7 · OpenDAS / vllm_cscc · GitLab

24 Jul, 2025 1 commit
- [Bugfix] Fix CUDA arch flags for MoE permute (#21426) · 2ded067f
  Ming Yang authored Jul 24, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  2ded067f
23 Jul, 2025 1 commit
- [Bugfix][ROCm][Build] Fix build regression on ROCm (#21393) · 3ec7170f
  Gregory Shtrasberg authored Jul 22, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  3ec7170f
22 Jul, 2025 2 commits

[Perf] Cuda Kernel for Per Token Group Quant (#21083) · 774d0c01
Wentao Ye authored Jul 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
774d0c01

[feat]: add SM100 support for cutlass FP8 groupGEMM (#20447) · 2c8db17c

Duncan Moss authored Jul 22, 2025


Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

2c8db17c

17 Jul, 2025 1 commit
- Update PyTorch to `torch==2.7.1` for CUDA (#21011) · 4e7dfbe7
  Michael Goin authored Jul 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4e7dfbe7
15 Jul, 2025 1 commit
- SM100 Cutlass MLA decode with unrestricted num_heads (< 128) for DeepSeek TP (#20769) · 8cdc3712
  Alexander Matveev authored Jul 14, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  8cdc3712
12 Jul, 2025 1 commit
- Revert "Use NVCC --compress-mode to reduce binary size by 30% #20694" (#20853) · b639327a
  Michael Goin authored Jul 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b639327a
10 Jul, 2025 2 commits
- [Bugfix][Build][Non-CUDA] Only referencing CMAKE_CUDA_COMPILER_VERSION on CUDA... · dc221ad7
  Gregory Shtrasberg authored Jul 10, 2025
```
[Bugfix][Build][Non-CUDA] Only referencing CMAKE_CUDA_COMPILER_VERSION on CUDA where it is defined (#20738)
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  dc221ad7
- Use NVCC `--compress-mode` to reduce binary size by 30% (#20694) · 49e8c7ea
  Michael Goin authored Jul 10, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  49e8c7ea
09 Jul, 2025 1 commit

[Kernel] Triton implementation of causal-conv1d for Mamba-based models (#18218) · 47043eb6

Tuan, Hoang-Trong authored Jul 09, 2025


Signed-off-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

47043eb6

04 Jul, 2025 1 commit
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95
02 Jul, 2025 1 commit
- [NVIDIA] Support Cutlass w8a8 FP8 for Blackwell Geforce GPUs (sm120) (#17280) · 9e5552aa
  Joonchen Liau authored Jul 02, 2025
```
Signed-off-by: kaln27 <liaojuncheng123@foxmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  9e5552aa
29 Jun, 2025 1 commit
- Fix cuda_archs_loose_intersection when handling sm_*a (#20207) · 6c9837a7
  Huy Do authored Jun 29, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  6c9837a7
27 Jun, 2025 2 commits
- [Feature] add quick all reduce (#19744) · 0740e29b
  li haoyang authored Jun 27, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  0740e29b
- [Bugfix] Build moe_data for both sm100 and sm90 (#20086) · 44d2e6af
  Michael Goin authored Jun 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  44d2e6af
17 Jun, 2025 1 commit
- Remove sm120 arch from sm100 cutlass kernel arch list (#19716) · bf57ccc5
  Michael Goin authored Jun 18, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bf57ccc5
14 Jun, 2025 1 commit
- Only build CUTLASS MoE kernels on Hopper (#19648) · bc956b38
  Huy Do authored Jun 14, 2025
  
  bc956b38
09 Jun, 2025 1 commit
- [Fix] Allow kernel compilation for CUDA capability 8.7 (#19328) · 59abbd84
  Conroy Cheers authored Jun 09, 2025
```
Signed-off-by: Conroy Cheers <conroy@corncheese.org>
```
  59abbd84
07 Jun, 2025 1 commit

[Kernel] Integrate CUTLASS MoE kernel with PPLX (#18762) · 84166fee

ElizaWszola authored Jun 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

84166fee

04 Jun, 2025 1 commit
- [KERNEL] Sampler. CUDA kernel for applying repetition penalty (#18437) · 5d6d1adf
  Vadim Gimpelson authored Jun 04, 2025
  
  5d6d1adf
03 Jun, 2025 1 commit
- [ROCm][Build] Clean up the ROCm build (#19040) · 9e6f61e8
  Gregory Shtrasberg authored Jun 02, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  9e6f61e8
28 May, 2025 1 commit
- [Build] Fixes for CMake install (#18570) · a3896c7f
  Luka Govedič authored May 27, 2025
  
  a3896c7f
27 May, 2025 1 commit

feat(rocm-support): support mamba2 on rocm (#18565) · a547aeb8

almersawi authored May 27, 2025


Signed-off-by: Islam Almersawi <islam.almersawi@openinnovation.ai>
Co-authored-by: Islam Almersawi <islam.almersawi@openinnovation.ai>

a547aeb8

23 May, 2025 1 commit
- [Bugfix][Build/CI] Fixup CUDA compiler version check for CUDA_SUPPORTED_ARCHS (#18579) · 1068556b
  Simon Mo authored May 23, 2025
  
  1068556b
22 May, 2025 1 commit

[Build/CI] Fix CUDA 11.8 build (#17679) · 6e588da0

Tyler Michael Smith authored May 22, 2025


Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>

6e588da0

15 May, 2025 1 commit
- [Build] Allow shipping PTX on a per-file basis (#18155) · c7852a6d
  Lucas Wilkinson authored May 15, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  c7852a6d
13 May, 2025 1 commit
- Implements dual-chunk-flash-attn backend for dual chunk attention with sparse... · 60f76243
  Tao He authored May 13, 2025
```
Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)
```
  60f76243
09 May, 2025 1 commit
- [Hardware/NVIDIA/Kernel] Enable nvidia/DeepSeek-R1-FP4 Model (#16362) · 0c0fdae8
  Pavani Majety authored May 09, 2025
  
  0c0fdae8
08 May, 2025 1 commit
- Add cutlass support for blackwell fp8 blockwise gemm (#14383) · 376786fa
  Shu Wang authored May 08, 2025
```
Signed-off-by: Shu Wang <shuw@nvidia.com>
```
  376786fa
05 May, 2025 2 commits
- [Kernel] some optimizations for dense marlin and moe marlin (#16850) · 1d0c9d6b
  Jinzhen Lin authored May 06, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  1d0c9d6b
- [Build/CI] Upgrade CUTLASS to 3.9.2 (#17641) · f62cad64
  Tyler Michael Smith authored May 04, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  f62cad64
03 May, 2025 1 commit
- [Build/CI] Upgrade CUTLASS to 3.9.1 (#17602) · c8386fa6
  Tyler Michael Smith authored May 03, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  c8386fa6
02 May, 2025 1 commit
- permute/unpermute kernel for moe optimization (#14568) · 3e887d2e
  Caleb_Du authored May 03, 2025
```
Signed-off-by: Caleb_Du <Caleb_Du@zju.edu.cn>
```
  3e887d2e
01 May, 2025 1 commit

[torch.compile] Add torch inductor pass for fusing silu_and_mul with... · 460a2b11

Sage Moore authored May 01, 2025


[torch.compile] Add torch inductor pass for fusing silu_and_mul with subsequent scaled_fp8_quant operations (#10867)
Signed-off-by: Sage Moore <sage@neuralmagic.com>

460a2b11

30 Apr, 2025 1 commit
- Update PyTorch to 2.7.0 (#16859) · 2c4f59af
  Huy Do authored Apr 29, 2025
  
  2c4f59af
27 Apr, 2025 1 commit
- [NVIDIA] Support Cutlass MLA for Blackwell GPUs (#16032) · ed7a29d9
  Kaixi Hou authored Apr 27, 2025
```
Signed-off-by: kaixih <kaixih@nvidia.com>
```
  ed7a29d9
22 Apr, 2025 1 commit
- [Performance][ROCm] Add skinny gemms for unquantized linear on ROCm (#15830) · 188b7f9b
  Charlie Fu authored Apr 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
```
  188b7f9b
15 Apr, 2025 1 commit

[Kernel] moe wna16 marlin kernel (#14447) · d06ba4ed

Jinzhen Lin authored Apr 15, 2025


Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

d06ba4ed

11 Apr, 2025 1 commit
- [Kernel] support merge_attn_states CUDA kernel, 3x speedup (#16173) · e9528f6d
  DefTruth authored Apr 11, 2025
```
Signed-off-by: DefTruth <qiustudent_r@163.com>
```
  e9528f6d
01 Apr, 2025 1 commit
- [Distributed] Add custom allreduce support for ROCM (#14125) · b7b7676d
  Ilya Markov authored Apr 01, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  b7b7676d