Commits · a40a133cf1ab32768c48f218f11737b9e1b5efc3 · OpenDAS / vllm_cscc

16 Jul, 2025 1 commit
- support rms_norm_dynamic_per_token_quant · 91feb245
  zhuwenwen authored Jul 16, 2025
  
  91feb245
12 Jul, 2025 1 commit
- fix rmsnrom precision · ac61d69b
  wanghl6 authored Jul 12, 2025
  
  ac61d69b
06 Jul, 2025 2 commits
- [BugFix] Fix: ImportError when building on hopper systems (#20513) · 40b86aa0
  Lucas Wilkinson authored Jul 06, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  40b86aa0
- [BUG] Fix #20484. Support empty sequence in cuda penalty kernel (#20491) · f73d02aa
  Vadim Gimpelson authored Jul 06, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@centml.ai>
```
  f73d02aa
04 Jul, 2025 2 commits
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95
- [Perf] Optimize Vectorization Utils for Int 8 Quantization Kernels (#20331) · 783921d8
  Wentao Ye authored Jul 04, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  783921d8
02 Jul, 2025 3 commits
- [NVIDIA] Support Cutlass w8a8 FP8 for Blackwell Geforce GPUs (sm120) (#17280) · 9e5552aa
  Joonchen Liau authored Jul 02, 2025
```
Signed-off-by: kaln27 <liaojuncheng123@foxmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  9e5552aa
- [Kernel][Bugfix] Fixup some warnings in nvfp4_blockwise_moe when CUDA < 12.8 (#20324) · 3be8d312
  Tyler Michael Smith authored Jul 01, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  3be8d312
- remove unused variables in marlin_template.h (#20236) · 9290de56
  周周周 authored Jul 02, 2025
  
  9290de56
01 Jul, 2025 3 commits
- [CPU] Update custom ops for the CPU backend (#20255) · 6cc1e7d9
  Li, Jiang authored Jul 01, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  6cc1e7d9
- Fix `numel()` downcast in vllm/csrc/moe/moe_align_sum_kernels.cu +2 (#17082) · 86debab5
  Richard Barnes authored Jul 01, 2025
```
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  86debab5
- 解决PA崩溃 · 5d3fb1d4
  zhuwenwen authored Jul 01, 2025
  
  5d3fb1d4
30 Jun, 2025 1 commit
- 解决PA 大batch，32k，崩溃问题 · 9d5187eb
  zhuwenwen authored Jun 30, 2025
  
  9d5187eb
27 Jun, 2025 6 commits
- [Bugfix] Fix some narrowing conversion warnings (#20141) · e8c3bd2c
  Tyler Michael Smith authored Jun 27, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  e8c3bd2c
- [Fix][ROCm] Remove unused variables to fix build error on GFX11/12 (#19891) · 94a55c76
  Hosang authored Jun 27, 2025
```
Signed-off-by: Hosang Yoon <hosang.yoon@amd.com>
```
  94a55c76
- update cutlass fa and pa · 4ddb5447
  zhuwenwen authored Jun 27, 2025
  
  4ddb5447
- [Feature] add quick all reduce (#19744) · 0740e29b
  li haoyang authored Jun 27, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  0740e29b
- [Bugfix] Build moe_data for both sm100 and sm90 (#20086) · 44d2e6af
  Michael Goin authored Jun 27, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  44d2e6af
- [Perf] SM100 FP8 GEMM Optimizations after cutlass_profiler (#20071) · 2d7779f8
  Ilya Markov authored Jun 27, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  2d7779f8
26 Jun, 2025 1 commit
- [CPU] Fix torch version in x86 CPU backend (#19258) · 0567c824
  Li, Jiang authored Jun 26, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0567c824
21 Jun, 2025 2 commits
- skip silu_and_mul_quant · d6a856f5
  zhuwenwen authored Jun 21, 2025
  
  d6a856f5
- fix build error · e87de76c
  zhuwenwen authored Jun 21, 2025
  
  e87de76c
17 Jun, 2025 1 commit
- [Perf] Optimize `moe_align_block_size` CUDA kernel (#19572) · ffb2cd6b
  Wentao Ye authored Jun 17, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  ffb2cd6b
16 Jun, 2025 2 commits
- [Kernel] GGUF MMVQ kernel for multiple input vectors (#18754) · dec66d25
  Szymon Ożóg authored Jun 16, 2025
```
Signed-off-by: SzymonOzog <szymon.ozog@gmail.com>
```
  dec66d25
- [MISC] Remove unused variableds in C++ (#19609) · c6703d1e
  Lu Fang authored Jun 16, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  c6703d1e
15 Jun, 2025 1 commit
- [Perf] Further tunings for SM100 FP8 CUTLASS kernel (#19566) · e13945f9
  Ilya Markov authored Jun 15, 2025
  
  e13945f9
14 Jun, 2025 1 commit
- [Hardware][NVIDIA][kernel] Fp4 MOE quant kernel optimization (#19500) · 294fc1e2
  jiahanc authored Jun 14, 2025
  
  294fc1e2
13 Jun, 2025 1 commit
- [Refactor] Remove unused variables in `moe_permute_unpermute_kernel.inl` (#19573) · ce9dc02c
  Wentao Ye authored Jun 13, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ce9dc02c
12 Jun, 2025 4 commits
- [Perf] Vectorize static / dynamic INT8 quant kernels (#19233) · b6efafd9
  Wentao Ye authored Jun 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b6efafd9
- add kvcache fp8 · 504a12b8
  zhuwenwen authored Jun 12, 2025
  
  504a12b8
- 解决大batch长seq崩溃问题 · d074a953
  zhuwenwen authored Jun 12, 2025
  
  d074a953
- [CI] change spell checker from codespell to typos (#18711) · 2f1c19b2
  Ning Xie authored Jun 12, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2f1c19b2
11 Jun, 2025 1 commit
- Support no privileged mode on CPU for docker and kubernetes deployments (#19241) · 5c8d34a4
  Louie Tsai authored Jun 11, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
```
  5c8d34a4
09 Jun, 2025 1 commit
- 增加4倍的临时空间，解决大batch 大seq时，临时空间不足访存越界的情况 · 259da693
  zhangshao authored Jun 09, 2025
  
  259da693
07 Jun, 2025 1 commit

[Kernel] Integrate CUTLASS MoE kernel with PPLX (#18762) · 84166fee

ElizaWszola authored Jun 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

84166fee

05 Jun, 2025 1 commit
- [Hardware][NVIDIA] FP4 MoE kernel optimization (#19110) · 61059bee
  Chiyue Wei authored Jun 05, 2025
```
Signed-off-by: Chiyue Wei <chiyuew@nvidia.com>
Co-authored-by: Chiyue Wei <chiyuew@nvidia.com>
```
  61059bee
04 Jun, 2025 4 commits
- [Perf] Tunings for SM100 FP8 CUTLASS kernel (#18778) · 53a5a0ce
  Michael Goin authored Jun 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  53a5a0ce
- Sm100 blockwise fp8 swap ab (#18564) · 5f2cd251
  Lain authored Jun 04, 2025
  
  5f2cd251
- 解决cudagraph模式下，小seq大batch PA变慢的bug · ea79ca42
  zhangshao authored Jun 04, 2025
  
  ea79ca42
- [NVIDIA] Add Cutlass MLA backend (#17625) · 41aa5784
  Kaixi Hou authored Jun 04, 2025
  
  41aa5784