Commits · fe79f042f560b71ecd2b624279d6b25b6586dd32 · OpenDAS / vllm_cscc

18 Jul, 2025 1 commit
- support rms_norm_dynamic_per_token_quant · fe79f042
  zhuwenwen authored Jul 18, 2025
  
  fe79f042
06 Jul, 2025 2 commits
- [BugFix] Fix: ImportError when building on hopper systems (#20513) · 40b86aa0
  Lucas Wilkinson authored Jul 06, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  40b86aa0
- [BUG] Fix #20484. Support empty sequence in cuda penalty kernel (#20491) · f73d02aa
  Vadim Gimpelson authored Jul 06, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  f73d02aa
04 Jul, 2025 2 commits
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95
- [Perf] Optimize Vectorization Utils for Int 8 Quantization Kernels (#20331) · 783921d8
  Wentao Ye authored Jul 04, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  783921d8
02 Jul, 2025 3 commits
- [NVIDIA] Support Cutlass w8a8 FP8 for Blackwell Geforce GPUs (sm120) (#17280) · 9e5552aa
  Joonchen Liau authored Jul 02, 2025
```
Signed-off-by: kaln27 <liaojuncheng123@foxmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  9e5552aa
- [Kernel][Bugfix] Fixup some warnings in nvfp4_blockwise_moe when CUDA < 12.8 (#20324) · 3be8d312
  Tyler Michael Smith authored Jul 01, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  3be8d312
- remove unused variables in marlin_template.h (#20236) · 9290de56
  周周周 authored Jul 02, 2025
  
  9290de56
01 Jul, 2025 2 commits
- [CPU] Update custom ops for the CPU backend (#20255) · 6cc1e7d9
  Li, Jiang authored Jul 01, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  6cc1e7d9
- Fix `numel()` downcast in vllm/csrc/moe/moe_align_sum_kernels.cu +2 (#17082) · 86debab5
  Richard Barnes authored Jul 01, 2025
```
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  86debab5
27 Jun, 2025 5 commits
- [Bugfix] Fix some narrowing conversion warnings (#20141) · e8c3bd2c
  Tyler Michael Smith authored Jun 27, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  e8c3bd2c
- [Fix][ROCm] Remove unused variables to fix build error on GFX11/12 (#19891) · 94a55c76
  Hosang authored Jun 27, 2025
```
Signed-off-by: Hosang Yoon <hosang.yoon@amd.com>
```
  94a55c76
- [Feature] add quick all reduce (#19744) · 0740e29b
  li haoyang authored Jun 27, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  0740e29b
- [Bugfix] Build moe_data for both sm100 and sm90 (#20086) · 44d2e6af
  Michael Goin authored Jun 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  44d2e6af
- [Perf] SM100 FP8 GEMM Optimizations after cutlass_profiler (#20071) · 2d7779f8
  Ilya Markov authored Jun 27, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  2d7779f8
26 Jun, 2025 1 commit
- [CPU] Fix torch version in x86 CPU backend (#19258) · 0567c824
  Li, Jiang authored Jun 26, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0567c824
17 Jun, 2025 1 commit
- [Perf] Optimize `moe_align_block_size` CUDA kernel (#19572) · ffb2cd6b
  Wentao Ye authored Jun 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  ffb2cd6b
16 Jun, 2025 2 commits
- [Kernel] GGUF MMVQ kernel for multiple input vectors (#18754) · dec66d25
  Szymon Ożóg authored Jun 16, 2025
```
Signed-off-by: SzymonOzog <szymon.ozog@gmail.com>
```
  dec66d25
- [MISC] Remove unused variableds in C++ (#19609) · c6703d1e
  Lu Fang authored Jun 16, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  c6703d1e
15 Jun, 2025 1 commit
- [Perf] Further tunings for SM100 FP8 CUTLASS kernel (#19566) · e13945f9
  Ilya Markov authored Jun 15, 2025
  
  e13945f9
14 Jun, 2025 1 commit
- [Hardware][NVIDIA][kernel] Fp4 MOE quant kernel optimization (#19500) · 294fc1e2
  jiahanc authored Jun 14, 2025
  
  294fc1e2
13 Jun, 2025 1 commit
- [Refactor] Remove unused variables in `moe_permute_unpermute_kernel.inl` (#19573) · ce9dc02c
  Wentao Ye authored Jun 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ce9dc02c
12 Jun, 2025 2 commits
- [Perf] Vectorize static / dynamic INT8 quant kernels (#19233) · b6efafd9
  Wentao Ye authored Jun 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b6efafd9
- [CI] change spell checker from codespell to typos (#18711) · 2f1c19b2
  Ning Xie authored Jun 12, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2f1c19b2
11 Jun, 2025 1 commit
- Support no privileged mode on CPU for docker and kubernetes deployments (#19241) · 5c8d34a4
  Louie Tsai authored Jun 11, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
```
  5c8d34a4
07 Jun, 2025 1 commit

[Kernel] Integrate CUTLASS MoE kernel with PPLX (#18762) · 84166fee

ElizaWszola authored Jun 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

84166fee

05 Jun, 2025 1 commit
- [Hardware][NVIDIA] FP4 MoE kernel optimization (#19110) · 61059bee
  Chiyue Wei authored Jun 05, 2025
```
Signed-off-by: Chiyue Wei <chiyuew@nvidia.com>
Co-authored-by: Chiyue Wei <chiyuew@nvidia.com>
```
  61059bee
04 Jun, 2025 4 commits
- [Perf] Tunings for SM100 FP8 CUTLASS kernel (#18778) · 53a5a0ce
  Michael Goin authored Jun 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  53a5a0ce
- Sm100 blockwise fp8 swap ab (#18564) · 5f2cd251
  Lain authored Jun 04, 2025
  
  5f2cd251
- [NVIDIA] Add Cutlass MLA backend (#17625) · 41aa5784
  Kaixi Hou authored Jun 04, 2025
  
  41aa5784
- [KERNEL] Sampler. CUDA kernel for applying repetition penalty (#18437) · 5d6d1adf
  Vadim Gimpelson authored Jun 04, 2025
  
  5d6d1adf
03 Jun, 2025 3 commits
- [Perf] Tune `scaled_fp8_quant` by increasing vectorization (#18844) · e31446b6
  Michael Goin authored Jun 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e31446b6
- [Kernel] DeepEP dispatch-combine kernel integration (#18434) · fa98d777
  Varun Sundar Rabindranath authored Jun 03, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fa98d777
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
31 May, 2025 1 commit
- [ROCm][Kernel] Add gfx950 support for skinny gemms (#18010) · 306d6040
  Charlie Fu authored May 31, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  306d6040
30 May, 2025 1 commit
- [BugFix] FA2 MLA Accuracy Issue (#18807) · 5fbbfe9a
  Lucas Wilkinson authored May 28, 2025
```
Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>
```
  5fbbfe9a
28 May, 2025 1 commit
- [BugFix] FA2 MLA Accuracy Issue (#18807) · ce75efee
  Lucas Wilkinson authored May 28, 2025
```
Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>
```
  ce75efee
27 May, 2025 1 commit

feat(rocm-support): support mamba2 on rocm (#18565) · a547aeb8

almersawi authored May 27, 2025


Signed-off-by: Islam Almersawi <islam.almersawi@openinnovation.ai>
Co-authored-by: Islam Almersawi <islam.almersawi@openinnovation.ai>

a547aeb8

23 May, 2025 1 commit
- [Bugfix] Add half type support in reshape_and_cache_cpu_impl on x86 cpu platform (#18430) · d0bc2f81
  Yuqi Zhang authored May 23, 2025
```
Signed-off-by: Yuqi Zhang <yuqizhang@google.com>
Co-authored-by: Yuqi Zhang <yuqizhang@google.com>
```
  d0bc2f81
22 May, 2025 1 commit

[Build/CI] Fix CUDA 11.8 build (#17679) · 6e588da0

Tyler Michael Smith authored May 22, 2025


Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>

6e588da0