Commits · ab9f2cfd1942f7ddfee658ce86ea96b4789862af · OpenDAS / vllm_cscc

13 Aug, 2025 2 commits
- [ROCm][Bugfix] Fix compilation error in topk softmax fused kernel (#22819) · c6cd5ca3
  kliuae authored Aug 14, 2025
```
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
```
  c6cd5ca3
- [Perf] Support topk softmax fused kernel for broader num_experts (#22211) · 4c558cf6
  shixianc authored Aug 12, 2025
```
Signed-off-by: Shixian Cui <shixian@amazon.com>
Co-authored-by: Shixian Cui <shixian@amazon.com>
```
  4c558cf6
09 Aug, 2025 1 commit
- [ROCm][Misc] Rename the context_len to seq_len in ROCm custom paged attention kernel (#22097) · b7c0942b
  Charlie Fu authored Aug 09, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  b7c0942b
08 Aug, 2025 1 commit
- [Kernel] Add support for block FP8 on SM120 (NVIDIA 5090 and RTX PRO 6000) (#22131) · 3303f134
  Junhao Li authored Aug 07, 2025
```
Signed-off-by: Junhao Li <junhao@ubicloud.com>
```
  3303f134
07 Aug, 2025 1 commit
- [v1] - Mamba1 Attention Metadata (#21249) · 46a13949
  Asaf Joseph Gardin authored Aug 07, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  46a13949
05 Aug, 2025 1 commit
- [Feature] Non-contiguous Support for FP8 Quantization (#21961) · 4771df7b
  Wentao Ye authored Aug 05, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  4771df7b
03 Aug, 2025 1 commit
- Support CUTLASS NVFP4 (w4a4) for Blackwell Geforce GPUs (SM120) (#21309) · 789562c2
  Roberto L. Castro authored Aug 03, 2025
```
Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
```
  789562c2
01 Aug, 2025 2 commits
- [Perf] Optimize `reshape_and_cache_flash` CUDA Kernel (#22036) · eefbf4a6
  Wentao Ye authored Aug 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eefbf4a6
- [Refactor] Fix Compile Warning #1444-D (#21462) · a59cd9d9
  Wentao Ye authored Aug 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a59cd9d9
30 Jul, 2025 3 commits
- [Hardware][CPU] Build fix for ARM without BF16 (#21848) · b876860c
  Eric Curtin authored Jul 30, 2025
```
Signed-off-by: Eric Curtin <ecurtin@redhat.com>
```
  b876860c
- [Perf] Using `__nv_fp8_e4m3` instead of `c10::e4m3` for `per_token_group_quant` (#21867) · 1b0a1555
  Wentao Ye authored Jul 29, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1b0a1555
- [Docs] Switch to better markdown linting pre-commit hook (#21851) · ba5c5e54
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ba5c5e54
29 Jul, 2025 1 commit
- [AMD][CI/Build][Bugfix] Guarding CUDA specific functions by ifndef ROCM (#21766) · 12a223ef
  Gregory Shtrasberg authored Jul 28, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  12a223ef
28 Jul, 2025 1 commit
- [Kernel] SM90 CUTLASS FP8 GEMM: add support for swap AB + kernel tuning (#20396) · c6c9122d
  lyrisz authored Jul 28, 2025
```
Signed-off-by: Faqin Zhong <faqin.zhong@gmail.com>
Co-authored-by: Duncan Moss <djm.moss@gmail.com>
```
  c6c9122d
27 Jul, 2025 1 commit
- Fix CUDA permute/unpermute for use with DeepGemm Moe (#17934) · 57c22e57
  Caleb_Du authored Jul 27, 2025
```
Signed-off-by: Caleb_Du <Caleb_Du@zju.edu.cn>
```
  57c22e57
26 Jul, 2025 2 commits
- [Bugfix][Apple Silicon] fix missing symbols when build from source on Mac with... · 9094d11c
  Yeju Zhou authored Jul 26, 2025
```
[Bugfix][Apple Silicon] fix missing symbols when build from source on Mac with Apple Silicon (#21380)
Signed-off-by: Yeju Zhou <yejuzhou@outlook.com>
```
  9094d11c
- [Perf] Cuda Kernel for Int8 Per Token Group Quant (#21476) · 75d29cf4
  Wentao Ye authored Jul 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  75d29cf4
25 Jul, 2025 1 commit
- [Kernel] Improve machete memory bound perf (#21556) · 136d750f
  czhu-cohere authored Jul 25, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  136d750f
24 Jul, 2025 2 commits
- [Bug] Fix Compressed Tensor NVFP4 `cutlass_fp4_group_mm` illegal memory access (#21465) · e8cb0d04
  Wentao Ye authored Jul 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e8cb0d04
- [Bugfix][ROCm] Fix for warp_size uses on host (#21205) · 90eeea8f
  Gregory Shtrasberg authored Jul 24, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  90eeea8f
23 Jul, 2025 1 commit
- [Bugfix][ROCm][Build] Fix build regression on ROCm (#21393) · 3ec7170f
  Gregory Shtrasberg authored Jul 22, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  3ec7170f
22 Jul, 2025 6 commits
- Revert "[Refactor] Fix Compile Warning #1444-D (#21208)" (#21384) · 226b452a
  Wentao Ye authored Jul 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  226b452a
- [Perf] Cuda Kernel for Per Token Group Quant (#21083) · 774d0c01
  Wentao Ye authored Jul 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  774d0c01
- [feat]: add SM100 support for cutlass FP8 groupGEMM (#20447) · 2c8db17c
  Duncan Moss authored Jul 22, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  2c8db17c
- [perf] Add fused MLA QKV + strided layernorm (#21116) · 4fb56914
  Mickaël Seznec authored Jul 22, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  4fb56914
- [Refactor] Fix Compile Warning #1444-D (#21208) · 6e5b5ca5
  Wentao Ye authored Jul 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6e5b5ca5
- Revert "[Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) (#21334) · e7b20426
  Ming Yang authored Jul 21, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  e7b20426
21 Jul, 2025 2 commits
- [perf] Speed up align sum kernels (#21079) · 0ec82edd
  Himanshu Jaju authored Jul 21, 2025
```
Signed-off-by: Himanshu Jaju <hj@mistral.ai>
```
  0ec82edd
- [CPU] Enable shared-memory based pipeline parallel for CPU backend (#21289) · a15a50fc
  Li, Jiang authored Jul 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a15a50fc
18 Jul, 2025 2 commits
- [Kernel] Apply torch.Tag.needs_fixed_stride_order only for torch==2.6.0 (#19346) · b2eb2b5a
  Richard Zou authored Jul 18, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  b2eb2b5a
- [Perf] Add swap_ab to SM90 FP8 non-block CUTLASS moe grouped gemm (#20911) · 5780121c
  shixianc authored Jul 17, 2025
```
Signed-off-by: Shixian Cui <shixian@amazon.com>
Co-authored-by: Shixian Cui <shixian@amazon.com>
```
  5780121c
17 Jul, 2025 1 commit
- [Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) · 9fb2d220
  ElizaWszola authored Jul 17, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  9fb2d220
16 Jul, 2025 2 commits
- [BugFix] Fix import error on non-blackwell machines (#21020) · d31a6471
  Lucas Wilkinson authored Jul 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  d31a6471
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
15 Jul, 2025 2 commits
- [ROCm] warpSize is being made non constexpr in ROCm 7.0 (#20330) · ed10f3ce
  Gregory Shtrasberg authored Jul 15, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  ed10f3ce
- SM100 Cutlass MLA decode with unrestricted num_heads (< 128) for DeepSeek TP (#20769) · 8cdc3712
  Alexander Matveev authored Jul 14, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  8cdc3712
14 Jul, 2025 1 commit

[ROCm] [Bugfix] [Critical]: Fix mamba compilation bug (#20883) · c488b928

TJian authored Jul 14, 2025


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

c488b928

12 Jul, 2025 1 commit
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738
11 Jul, 2025 2 commits
- [Kernel] Basic tuned configs for NVFP4 CUTLASS dense GEMM (#20646) · d47661f0
  Michael Goin authored Jul 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d47661f0
- [fix]: disable cutlass block scaled group gemm for EP (#20781) · 5923ab95
  Duncan Moss authored Jul 10, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
```
  5923ab95