Commits · eefbf4a68b7b0a5b8364a59647906be1b7f043e2 · OpenDAS / vllm_cscc

01 Aug, 2025 2 commits
- [Perf] Optimize `reshape_and_cache_flash` CUDA Kernel (#22036) · eefbf4a6
  Wentao Ye authored Aug 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eefbf4a6
- [Refactor] Fix Compile Warning #1444-D (#21462) · a59cd9d9
  Wentao Ye authored Aug 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a59cd9d9
30 Jul, 2025 3 commits
- [Hardware][CPU] Build fix for ARM without BF16 (#21848) · b876860c
  Eric Curtin authored Jul 30, 2025
```
Signed-off-by: Eric Curtin <ecurtin@redhat.com>
```
  b876860c
- [Perf] Using `__nv_fp8_e4m3` instead of `c10::e4m3` for `per_token_group_quant` (#21867) · 1b0a1555
  Wentao Ye authored Jul 29, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1b0a1555
- [Docs] Switch to better markdown linting pre-commit hook (#21851) · ba5c5e54
  Harry Mellor authored Jul 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  ba5c5e54
29 Jul, 2025 1 commit
- [AMD][CI/Build][Bugfix] Guarding CUDA specific functions by ifndef ROCM (#21766) · 12a223ef
  Gregory Shtrasberg authored Jul 28, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  12a223ef
28 Jul, 2025 1 commit
- [Kernel] SM90 CUTLASS FP8 GEMM: add support for swap AB + kernel tuning (#20396) · c6c9122d
  lyrisz authored Jul 28, 2025
```
Signed-off-by: Faqin Zhong <faqin.zhong@gmail.com>
Co-authored-by: Duncan Moss <djm.moss@gmail.com>
```
  c6c9122d
27 Jul, 2025 1 commit
- Fix CUDA permute/unpermute for use with DeepGemm Moe (#17934) · 57c22e57
  Caleb_Du authored Jul 27, 2025
```
Signed-off-by: Caleb_Du <Caleb_Du@zju.edu.cn>
```
  57c22e57
26 Jul, 2025 2 commits
- [Bugfix][Apple Silicon] fix missing symbols when build from source on Mac with... · 9094d11c
  Yeju Zhou authored Jul 26, 2025
```
[Bugfix][Apple Silicon] fix missing symbols when build from source on Mac with Apple Silicon (#21380)
Signed-off-by: Yeju Zhou <yejuzhou@outlook.com>
```
  9094d11c
- [Perf] Cuda Kernel for Int8 Per Token Group Quant (#21476) · 75d29cf4
  Wentao Ye authored Jul 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  75d29cf4
25 Jul, 2025 1 commit
- [Kernel] Improve machete memory bound perf (#21556) · 136d750f
  czhu-cohere authored Jul 25, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  136d750f
24 Jul, 2025 2 commits
- [Bug] Fix Compressed Tensor NVFP4 `cutlass_fp4_group_mm` illegal memory access (#21465) · e8cb0d04
  Wentao Ye authored Jul 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e8cb0d04
- [Bugfix][ROCm] Fix for warp_size uses on host (#21205) · 90eeea8f
  Gregory Shtrasberg authored Jul 24, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  90eeea8f
23 Jul, 2025 1 commit
- [Bugfix][ROCm][Build] Fix build regression on ROCm (#21393) · 3ec7170f
  Gregory Shtrasberg authored Jul 22, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  3ec7170f
22 Jul, 2025 6 commits
- Revert "[Refactor] Fix Compile Warning #1444-D (#21208)" (#21384) · 226b452a
  Wentao Ye authored Jul 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  226b452a
- [Perf] Cuda Kernel for Per Token Group Quant (#21083) · 774d0c01
  Wentao Ye authored Jul 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  774d0c01
- [feat]: add SM100 support for cutlass FP8 groupGEMM (#20447) · 2c8db17c
  Duncan Moss authored Jul 22, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  2c8db17c
- [perf] Add fused MLA QKV + strided layernorm (#21116) · 4fb56914
  Mickaël Seznec authored Jul 22, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  4fb56914
- [Refactor] Fix Compile Warning #1444-D (#21208) · 6e5b5ca5
  Wentao Ye authored Jul 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6e5b5ca5
- Revert "[Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) (#21334) · e7b20426
  Ming Yang authored Jul 21, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  e7b20426
21 Jul, 2025 2 commits
- [perf] Speed up align sum kernels (#21079) · 0ec82edd
  Himanshu Jaju authored Jul 21, 2025
```
Signed-off-by: Himanshu Jaju <hj@mistral.ai>
```
  0ec82edd
- [CPU] Enable shared-memory based pipeline parallel for CPU backend (#21289) · a15a50fc
  Li, Jiang authored Jul 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a15a50fc
18 Jul, 2025 2 commits
- [Kernel] Apply torch.Tag.needs_fixed_stride_order only for torch==2.6.0 (#19346) · b2eb2b5a
  Richard Zou authored Jul 18, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  b2eb2b5a
- [Perf] Add swap_ab to SM90 FP8 non-block CUTLASS moe grouped gemm (#20911) · 5780121c
  shixianc authored Jul 17, 2025
```
Signed-off-by: Shixian Cui <shixian@amazon.com>
Co-authored-by: Shixian Cui <shixian@amazon.com>
```
  5780121c
17 Jul, 2025 1 commit
- [Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) · 9fb2d220
  ElizaWszola authored Jul 17, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  9fb2d220
16 Jul, 2025 2 commits
- [BugFix] Fix import error on non-blackwell machines (#21020) · d31a6471
  Lucas Wilkinson authored Jul 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  d31a6471
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
15 Jul, 2025 2 commits
- [ROCm] warpSize is being made non constexpr in ROCm 7.0 (#20330) · ed10f3ce
  Gregory Shtrasberg authored Jul 15, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  ed10f3ce
- SM100 Cutlass MLA decode with unrestricted num_heads (< 128) for DeepSeek TP (#20769) · 8cdc3712
  Alexander Matveev authored Jul 14, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  8cdc3712
14 Jul, 2025 1 commit

[ROCm] [Bugfix] [Critical]: Fix mamba compilation bug (#20883) · c488b928

TJian authored Jul 14, 2025


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

c488b928

12 Jul, 2025 1 commit
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738
11 Jul, 2025 2 commits
- [Kernel] Basic tuned configs for NVFP4 CUTLASS dense GEMM (#20646) · d47661f0
  Michael Goin authored Jul 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d47661f0
- [fix]: disable cutlass block scaled group gemm for EP (#20781) · 5923ab95
  Duncan Moss authored Jul 10, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
```
  5923ab95
10 Jul, 2025 1 commit
- [Hardware][CPU] Vllm int8 quantization enablement for ARM CPU (#14129) · c7753a98
  nishith-fujitsu authored Jul 10, 2025
```
Signed-off-by: nishith-fujitsu <nishith.jaiswal@fujitsu.com>
```
  c7753a98
09 Jul, 2025 2 commits

[Kernel] Triton implementation of causal-conv1d for Mamba-based models (#18218) · 47043eb6

Tuan, Hoang-Trong authored Jul 09, 2025


Signed-off-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

47043eb6

Replace `multiply_add` with `homogeneous_multiply_add` to Address Clang... · 5eaf5700

Wenxin Cheng authored Jul 08, 2025


Replace `multiply_add` with `homogeneous_multiply_add` to Address Clang Template Parameter Issue (#20142)
Signed-off-by: Lu Fang <lufang@fb.com>

5eaf5700

08 Jul, 2025 1 commit
- [Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE (#20166) · c438183e
  Ming Yang authored Jul 08, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
```
  c438183e
06 Jul, 2025 2 commits
- [BugFix] Fix: ImportError when building on hopper systems (#20513) · 40b86aa0
  Lucas Wilkinson authored Jul 06, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  40b86aa0
- [BUG] Fix #20484. Support empty sequence in cuda penalty kernel (#20491) · f73d02aa
  Vadim Gimpelson authored Jul 06, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  f73d02aa
04 Jul, 2025 1 commit
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95