Commits · 2c8db17cfd6f2026549d7ac708be5109dbf7a2e8 · OpenDAS / vllm_cscc

22 Jul, 2025 4 commits
- [feat]: add SM100 support for cutlass FP8 groupGEMM (#20447) · 2c8db17c
  Duncan Moss authored Jul 22, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  2c8db17c
- [perf] Add fused MLA QKV + strided layernorm (#21116) · 4fb56914
  Mickaël Seznec authored Jul 22, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  4fb56914
- [Refactor] Fix Compile Warning #1444-D (#21208) · 6e5b5ca5
  Wentao Ye authored Jul 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6e5b5ca5
- Revert "[Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) (#21334) · e7b20426
  Ming Yang authored Jul 21, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  e7b20426
21 Jul, 2025 2 commits
- [perf] Speed up align sum kernels (#21079) · 0ec82edd
  Himanshu Jaju authored Jul 21, 2025
```
Signed-off-by: Himanshu Jaju <hj@mistral.ai>
```
  0ec82edd
- [CPU] Enable shared-memory based pipeline parallel for CPU backend (#21289) · a15a50fc
  Li, Jiang authored Jul 22, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a15a50fc
18 Jul, 2025 2 commits
- [Kernel] Apply torch.Tag.needs_fixed_stride_order only for torch==2.6.0 (#19346) · b2eb2b5a
  Richard Zou authored Jul 18, 2025
```
Signed-off-by: rzou <zou3519@gmail.com>
```
  b2eb2b5a
- [Perf] Add swap_ab to SM90 FP8 non-block CUTLASS moe grouped gemm (#20911) · 5780121c
  shixianc authored Jul 17, 2025
```
Signed-off-by: Shixian Cui <shixian@amazon.com>
Co-authored-by: Shixian Cui <shixian@amazon.com>
```
  5780121c
17 Jul, 2025 1 commit
- [Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) · 9fb2d220
  ElizaWszola authored Jul 17, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  9fb2d220
16 Jul, 2025 2 commits
- [BugFix] Fix import error on non-blackwell machines (#21020) · d31a6471
  Lucas Wilkinson authored Jul 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  d31a6471
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
15 Jul, 2025 2 commits
- [ROCm] warpSize is being made non constexpr in ROCm 7.0 (#20330) · ed10f3ce
  Gregory Shtrasberg authored Jul 15, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  ed10f3ce
- SM100 Cutlass MLA decode with unrestricted num_heads (< 128) for DeepSeek TP (#20769) · 8cdc3712
  Alexander Matveev authored Jul 14, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  8cdc3712
14 Jul, 2025 1 commit

[ROCm] [Bugfix] [Critical]: Fix mamba compilation bug (#20883) · c488b928

TJian authored Jul 14, 2025


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

c488b928

12 Jul, 2025 1 commit
- [Model] New model support for microsoft/Phi-4-mini-flash-reasoning (#20702) · 2c11a738
  Congcong Chen authored Jul 12, 2025
```
Signed-off-by: Congcong Chen <congcongchen@microsoft.com>
```
  2c11a738
11 Jul, 2025 2 commits
- [Kernel] Basic tuned configs for NVFP4 CUTLASS dense GEMM (#20646) · d47661f0
  Michael Goin authored Jul 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d47661f0
- [fix]: disable cutlass block scaled group gemm for EP (#20781) · 5923ab95
  Duncan Moss authored Jul 10, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
```
  5923ab95
10 Jul, 2025 1 commit
- [Hardware][CPU] Vllm int8 quantization enablement for ARM CPU (#14129) · c7753a98
  nishith-fujitsu authored Jul 10, 2025
```
Signed-off-by: nishith-fujitsu <nishith.jaiswal@fujitsu.com>
```
  c7753a98
09 Jul, 2025 2 commits

[Kernel] Triton implementation of causal-conv1d for Mamba-based models (#18218) · 47043eb6

Tuan, Hoang-Trong authored Jul 09, 2025


Signed-off-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

47043eb6

Replace `multiply_add` with `homogeneous_multiply_add` to Address Clang... · 5eaf5700

Wenxin Cheng authored Jul 08, 2025


Replace `multiply_add` with `homogeneous_multiply_add` to Address Clang Template Parameter Issue (#20142)
Signed-off-by: Lu Fang <lufang@fb.com>

5eaf5700

08 Jul, 2025 1 commit
- [Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE (#20166) · c438183e
  Ming Yang authored Jul 08, 2025
```
Signed-off-by: Ming Yang <yming@meta.com>
```
  c438183e
06 Jul, 2025 2 commits
- [BugFix] Fix: ImportError when building on hopper systems (#20513) · 40b86aa0
  Lucas Wilkinson authored Jul 06, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  40b86aa0
- [BUG] Fix #20484. Support empty sequence in cuda penalty kernel (#20491) · f73d02aa
  Vadim Gimpelson authored Jul 06, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  f73d02aa
04 Jul, 2025 2 commits
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95
- [Perf] Optimize Vectorization Utils for Int 8 Quantization Kernels (#20331) · 783921d8
  Wentao Ye authored Jul 04, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  783921d8
02 Jul, 2025 3 commits
- [NVIDIA] Support Cutlass w8a8 FP8 for Blackwell Geforce GPUs (sm120) (#17280) · 9e5552aa
  Joonchen Liau authored Jul 02, 2025
```
Signed-off-by: kaln27 <liaojuncheng123@foxmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  9e5552aa
- [Kernel][Bugfix] Fixup some warnings in nvfp4_blockwise_moe when CUDA < 12.8 (#20324) · 3be8d312
  Tyler Michael Smith authored Jul 01, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  3be8d312
- remove unused variables in marlin_template.h (#20236) · 9290de56
  周周周 authored Jul 02, 2025
  
  9290de56
01 Jul, 2025 2 commits
- [CPU] Update custom ops for the CPU backend (#20255) · 6cc1e7d9
  Li, Jiang authored Jul 01, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  6cc1e7d9
- Fix `numel()` downcast in vllm/csrc/moe/moe_align_sum_kernels.cu +2 (#17082) · 86debab5
  Richard Barnes authored Jul 01, 2025
```
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  86debab5
27 Jun, 2025 5 commits
- [Bugfix] Fix some narrowing conversion warnings (#20141) · e8c3bd2c
  Tyler Michael Smith authored Jun 27, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  e8c3bd2c
- [Fix][ROCm] Remove unused variables to fix build error on GFX11/12 (#19891) · 94a55c76
  Hosang authored Jun 27, 2025
```
Signed-off-by: Hosang Yoon <hosang.yoon@amd.com>
```
  94a55c76
- [Feature] add quick all reduce (#19744) · 0740e29b
  li haoyang authored Jun 27, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  0740e29b
- [Bugfix] Build moe_data for both sm100 and sm90 (#20086) · 44d2e6af
  Michael Goin authored Jun 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  44d2e6af
- [Perf] SM100 FP8 GEMM Optimizations after cutlass_profiler (#20071) · 2d7779f8
  Ilya Markov authored Jun 27, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  2d7779f8
26 Jun, 2025 1 commit
- [CPU] Fix torch version in x86 CPU backend (#19258) · 0567c824
  Li, Jiang authored Jun 26, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0567c824
17 Jun, 2025 1 commit
- [Perf] Optimize `moe_align_block_size` CUDA kernel (#19572) · ffb2cd6b
  Wentao Ye authored Jun 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  ffb2cd6b
16 Jun, 2025 2 commits
- [Kernel] GGUF MMVQ kernel for multiple input vectors (#18754) · dec66d25
  Szymon Ożóg authored Jun 16, 2025
```
Signed-off-by: SzymonOzog <szymon.ozog@gmail.com>
```
  dec66d25
- [MISC] Remove unused variableds in C++ (#19609) · c6703d1e
  Lu Fang authored Jun 16, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  c6703d1e
15 Jun, 2025 1 commit
- [Perf] Further tunings for SM100 FP8 CUTLASS kernel (#19566) · e13945f9
  Ilya Markov authored Jun 15, 2025
  
  e13945f9