Commits · 2d465ec7071e05d4bdd77770125e561065fc814a · OpenDAS / vllm_cscc · GitLab

29 Apr, 2025 1 commit
- skip cutlass_mla_decode · 2d465ec7
  zhuwenwen authored Apr 29, 2025
  
  2d465ec7
28 Apr, 2025 1 commit
- [Bugfix] Fix cutlass dispatch for fp8/int8 to properly invoke M<=16 c… (#16751) · c12df53b
  TherLF authored Apr 28, 2025
```
Signed-off-by: Ther-LF <2639852836@qq.com>
```
  c12df53b
27 Apr, 2025 1 commit
- [NVIDIA] Support Cutlass MLA for Blackwell GPUs (#16032) · ed7a29d9
  Kaixi Hou authored Apr 27, 2025
```
Signed-off-by: kaixih <kaixih@nvidia.com>
```
  ed7a29d9
26 Apr, 2025 2 commits
- Allocate kv_cache with stride order (#16605) · 9e96f56e
  Shu Wang authored Apr 26, 2025
```
Signed-off-by: shuw <shuw@nvidia.com>
```
  9e96f56e
- [MISC][AMD] Add unused annotation to rocm kernel file (#17097) · c8e5be35
  Lu Fang authored Apr 25, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  c8e5be35
22 Apr, 2025 2 commits
- [Performance][ROCm] Add skinny gemms for unquantized linear on ROCm (#15830) · 188b7f9b
  Charlie Fu authored Apr 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
```
  188b7f9b
- [Kernel] Add expert_map support to Cutlass FP8 MOE (#16861) · 7b8a2ab7
  Varun Sundar Rabindranath authored Apr 21, 2025
```
Signed-off-by: varun sundar rabindranath <vsundarr@redhat.com>
Co-authored-by: varun sundar rabindranath <vsundarr@redhat.com>
```
  7b8a2ab7
18 Apr, 2025 1 commit
- [BugFix] Accuracy fix for llama4 int4 - improperly casted scales (#16801) · 7eb42556
  Lucas Wilkinson authored Apr 18, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  7eb42556
16 Apr, 2025 1 commit
- [Bugfix][Kernel] fix potential cuda graph broken for merge_attn_states kernel (#16693) · e82ee40d
  DefTruth authored Apr 16, 2025
```
Signed-off-by: DefTruth <qiustudent_r@163.com>
```
  e82ee40d
15 Apr, 2025 1 commit

[Kernel] moe wna16 marlin kernel (#14447) · d06ba4ed

Jinzhen Lin authored Apr 15, 2025


Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

d06ba4ed

12 Apr, 2025 1 commit
- fix: spelling (#16466) · 4a3a5187
  Tianer Zhou authored Apr 12, 2025
```
Signed-off-by: Tianer Zhou <ezhoureal@gmail.com>
```
  4a3a5187
11 Apr, 2025 1 commit
- [Kernel] support merge_attn_states CUDA kernel, 3x speedup (#16173) · e9528f6d
  DefTruth authored Apr 11, 2025
```
Signed-off-by: DefTruth <qiustudent_r@163.com>
```
  e9528f6d
09 Apr, 2025 2 commits
- [BugFix] fix some typos found by typos. (#16314) · 04149cce
  yihong authored Apr 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  04149cce
- [Bugfix] fix gettid method is not define (#16084) · 4e9cf8c1
  rongfu.leng authored Apr 09, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  4e9cf8c1
08 Apr, 2025 1 commit
- [BugFix][ROCm] Fix GGUF MoE Dispatch Block_Dim for ROCm (#16247) · 9351f91b
  TY-AMD authored Apr 08, 2025
```
Signed-off-by: Tianyuan Wu <Tianyuan.Wu@amd.com>
```
  9351f91b
07 Apr, 2025 1 commit
- remove __MEMORY_SCOPE_SYSTEM · d103e0cf
  zhuwenwen authored Apr 07, 2025
  
  d103e0cf
06 Apr, 2025 1 commit
- [Bugfix] fix use_atomic_add support of marlin kernel when using v1 engine (#15946) · 2fa66ef7
  Jinzhen Lin authored Apr 06, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  2fa66ef7
04 Apr, 2025 1 commit
- [Bugfix][kernels] Fix half2float conversion in gguf kernels (#15995) · 230b131b
  Isotr0py authored Apr 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  230b131b
03 Apr, 2025 1 commit

[ROCM][KERNEL] Paged attention for V1 (#15720) · e73ff24e

Aleksandr Malyshev authored Apr 02, 2025


Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Signed-off-by: root <root@banff-cyxtera-s65-4.amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: root <root@banff-cyxtera-s65-4.amd.com>

e73ff24e

02 Apr, 2025 2 commits
- [CPU][Bugfix] Using custom allreduce for CPU backend (#15934) · 550b2801
  Li, Jiang authored Apr 02, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  550b2801
- [Kernel] Add more dtype support for GGUF dequantization (#15879) · 90969fb3
  LukasBluebaum authored Apr 02, 2025
```
Signed-off-by: lukas.bluebaum <lukas.bluebaum@aleph-alpha.com>
```
  90969fb3
01 Apr, 2025 1 commit
- [Distributed] Add custom allreduce support for ROCM (#14125) · b7b7676d
  Ilya Markov authored Apr 01, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  b7b7676d
31 Mar, 2025 2 commits
- [V1] Fully Transparent Implementation of CPU Offloading (#15354) · 555aa219
  youkaichao authored Mar 31, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  555aa219
- [Feature][ROCm]Enable fusion pass for torch.compile on ROCm (#15050) · e8582945
  Charlie Fu authored Mar 31, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  e8582945
27 Mar, 2025 1 commit

[Kernel] CUTLASS grouped gemm fp8 MoE kernel (#13972) · 9239bf71

ElizaWszola authored Mar 27, 2025


Signed-off-by: ElizaWszola <eliza@neuralmagic.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Lucas Wilkinson <wilkinson.lucas@gmail.com>

9239bf71

25 Mar, 2025 4 commits
- [Kernel] Fix conflicting macro names for gguf kernels (#15456) · a6081600
  Szymon Ożóg authored Mar 25, 2025
```
Signed-off-by: SzymonOzog <szymon.ozog@gmail.com>
```
  a6081600
- [Kernel][CPU] CPU MLA (#14744) · 4f044b1d
  Thien Tran authored Mar 25, 2025
```
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  4f044b1d
- [Models]support blas and moe nn layout of deepseek-v3 · 89d1dd57
  zhuwenwen authored Mar 25, 2025
  
  89d1dd57
- Fix CUDA kernel index data type in... · 051da7ef
  Lu Fang authored Mar 25, 2025
```
Fix CUDA kernel index data type in vllm/csrc/quantization/gptq_marlin/awq_marlin_repack.cu +10 (#15160)
Signed-off-by: Lu Fang <lufang@fb.com>
Co-authored-by: Richard Barnes <rbarnes@meta.com>
```
  051da7ef
24 Mar, 2025 1 commit
- [Kernel] allow non-contiguous input for marlin kernel (#14658) · 6b3cc75b
  Jinzhen Lin authored Mar 24, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  6b3cc75b
21 Mar, 2025 1 commit

Fix CUDA kernel index data type in... · d3ccbd63

Lu Fang authored Mar 20, 2025

Fix CUDA kernel index data type in vllm/csrc/quantization/fused_kernels/layernorm_utils.cuh +10 (#15159)
Signed-off-by: Lu Fang <lufang@fb.com>
Co-authored-by: Richard Barnes <rbarnes@meta.com>

d3ccbd63

19 Mar, 2025 3 commits
- skip rms_norm_dynamic_per_token_quant · 0dc4c8e9
  zhuwenwen authored Mar 19, 2025
  
  0dc4c8e9
- skip fp8 kernel and _rocm_C extension · 9e053941
  zhuwenwen authored Mar 19, 2025
  
  9e053941
- [Fix]atomicAdd ambiguous · f850f22a
  zhuwenwen authored Mar 19, 2025
  
  f850f22a
18 Mar, 2025 1 commit
- [Misc][Docs] fix the comments of KV_T and CACHE_T in CALL_RESHAPE_AND_CACHE_XX macros (#14347) · 64fc2193
  Serena authored Mar 18, 2025
  
  64fc2193
17 Mar, 2025 1 commit
- [MISC] More AMD unused var clean up (#14926) · cd0cd851
  Lu Fang authored Mar 17, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  cd0cd851
15 Mar, 2025 2 commits
- [CPU] Support FP8 KV cache (#14741) · a2ae4965
  Li, Jiang authored Mar 15, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a2ae4965
- [Misc][Easy] Annotate unused vars in the csrc files (#14798) · 8c0d15d5
  Lu Fang authored Mar 14, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8c0d15d5
14 Mar, 2025 2 commits
- [Bugfix][Kernel]: Fix AllSpark kernel compilation errors and enable for CUDA < 12.0 (#14430) · 977a1677
  Yajie Wang authored Mar 15, 2025
```
Signed-off-by: wyj371990 <wyj371990@alibaba-inc.com>
```
  977a1677
- [Bugfix][W8A8] fixed cutlass block fp8 binding (#14796) · 40253bab
  DefTruth authored Mar 14, 2025
  
  40253bab