Commits · 45273722ac098efeade690c4b9e575c38f410bbc · OpenDAS / vllm_cscc

14 May, 2025 1 commit
- add kvint8 · 45273722
  xiabo authored May 14, 2025
  
  45273722
13 May, 2025 1 commit
- 提升bf16 pa精度 · 98955c1f
  zhangshao authored May 13, 2025
  
  98955c1f
28 Apr, 2025 1 commit
- [Bugfix] Fix cutlass dispatch for fp8/int8 to properly invoke M<=16 c… (#16751) · c12df53b
  TherLF authored Apr 28, 2025
```
Signed-off-by: Ther-LF <2639852836@qq.com>
```
  c12df53b
27 Apr, 2025 1 commit
- [NVIDIA] Support Cutlass MLA for Blackwell GPUs (#16032) · ed7a29d9
  Kaixi Hou authored Apr 27, 2025
```
Signed-off-by: kaixih <kaixih@nvidia.com>
```
  ed7a29d9
26 Apr, 2025 2 commits
- Allocate kv_cache with stride order (#16605) · 9e96f56e
  Shu Wang authored Apr 26, 2025
```
Signed-off-by: shuw <shuw@nvidia.com>
```
  9e96f56e
- [MISC][AMD] Add unused annotation to rocm kernel file (#17097) · c8e5be35
  Lu Fang authored Apr 25, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  c8e5be35
22 Apr, 2025 2 commits
- [Performance][ROCm] Add skinny gemms for unquantized linear on ROCm (#15830) · 188b7f9b
  Charlie Fu authored Apr 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
```
  188b7f9b
- [Kernel] Add expert_map support to Cutlass FP8 MOE (#16861) · 7b8a2ab7
  Varun Sundar Rabindranath authored Apr 21, 2025
```
Signed-off-by: varun sundar rabindranath <vsundarr@redhat.com>
Co-authored-by: varun sundar rabindranath <vsundarr@redhat.com>
```
  7b8a2ab7
18 Apr, 2025 3 commits
- [BugFix] Accuracy fix for llama4 int4 - improperly casted scales (#16801) · 7eb42556
  Lucas Wilkinson authored Apr 18, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  7eb42556
- update barrier_at_start and barrier_at_end · f587d8f7
  zhuwenwen authored Apr 18, 2025
  
  f587d8f7
- add K100AI custom allreduce · b0eacb5b
  zhuwenwen authored Apr 18, 2025
  
  b0eacb5b
16 Apr, 2025 1 commit
- [Bugfix][Kernel] fix potential cuda graph broken for merge_attn_states kernel (#16693) · e82ee40d
  DefTruth authored Apr 16, 2025
```
Signed-off-by: DefTruth <qiustudent_r@163.com>
```
  e82ee40d
15 Apr, 2025 1 commit

[Kernel] moe wna16 marlin kernel (#14447) · d06ba4ed

Jinzhen Lin authored Apr 15, 2025


Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

d06ba4ed

12 Apr, 2025 1 commit
- fix: spelling (#16466) · 4a3a5187
  Tianer Zhou authored Apr 12, 2025
```
Signed-off-by: Tianer Zhou <ezhoureal@gmail.com>
```
  4a3a5187
11 Apr, 2025 1 commit
- [Kernel] support merge_attn_states CUDA kernel, 3x speedup (#16173) · e9528f6d
  DefTruth authored Apr 11, 2025
```
Signed-off-by: DefTruth <qiustudent_r@163.com>
```
  e9528f6d
09 Apr, 2025 2 commits
- [BugFix] fix some typos found by typos. (#16314) · 04149cce
  yihong authored Apr 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  04149cce
- [Bugfix] fix gettid method is not define (#16084) · 4e9cf8c1
  rongfu.leng authored Apr 09, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  4e9cf8c1
08 Apr, 2025 1 commit
- [BugFix][ROCm] Fix GGUF MoE Dispatch Block_Dim for ROCm (#16247) · 9351f91b
  TY-AMD authored Apr 08, 2025
```
Signed-off-by: Tianyuan Wu <Tianyuan.Wu@amd.com>
```
  9351f91b
06 Apr, 2025 1 commit
- [Bugfix] fix use_atomic_add support of marlin kernel when using v1 engine (#15946) · 2fa66ef7
  Jinzhen Lin authored Apr 06, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  2fa66ef7
04 Apr, 2025 1 commit
- [Bugfix][kernels] Fix half2float conversion in gguf kernels (#15995) · 230b131b
  Isotr0py authored Apr 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  230b131b
03 Apr, 2025 1 commit

[ROCM][KERNEL] Paged attention for V1 (#15720) · e73ff24e

Aleksandr Malyshev authored Apr 02, 2025


Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Signed-off-by: root <root@banff-cyxtera-s65-4.amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: root <root@banff-cyxtera-s65-4.amd.com>

e73ff24e

02 Apr, 2025 4 commits
- [CPU][Bugfix] Using custom allreduce for CPU backend (#15934) · 550b2801
  Li, Jiang authored Apr 02, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  550b2801
- remove csrc/moe/moe_ops.h · 087254b9
  zhuwenwen authored Apr 02, 2025
  
  087254b9
- [Kernel] Add more dtype support for GGUF dequantization (#15879) · 90969fb3
  LukasBluebaum authored Apr 02, 2025
```
Signed-off-by: lukas.bluebaum <lukas.bluebaum@aleph-alpha.com>
```
  90969fb3
- add moe_wna16_gemm · c8492797
  zhuwenwen authored Apr 02, 2025
  
  c8492797
01 Apr, 2025 2 commits
- 去掉自研专家并行代码 · 9beadbfb
  王敏 authored Apr 01, 2025
  
  9beadbfb
- [Distributed] Add custom allreduce support for ROCM (#14125) · b7b7676d
  Ilya Markov authored Apr 01, 2025
```
Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
  b7b7676d
31 Mar, 2025 3 commits
- [V1] Fully Transparent Implementation of CPU Offloading (#15354) · 555aa219
  youkaichao authored Mar 31, 2025
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  555aa219
- [Feature][ROCm]Enable fusion pass for torch.compile on ROCm (#15050) · e8582945
  Charlie Fu authored Mar 31, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  e8582945
- skip fp8 kernels and paged_attention_rocm · 52675626
  zhuwenwen authored Mar 31, 2025
  
  52675626
27 Mar, 2025 1 commit

[Kernel] CUTLASS grouped gemm fp8 MoE kernel (#13972) · 9239bf71

ElizaWszola authored Mar 27, 2025


Signed-off-by: ElizaWszola <eliza@neuralmagic.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Lucas Wilkinson <wilkinson.lucas@gmail.com>

9239bf71

25 Mar, 2025 3 commits

[Kernel] Fix conflicting macro names for gguf kernels (#15456) · a6081600
Szymon Ożóg authored Mar 25, 2025
```
Signed-off-by: SzymonOzog <szymon.ozog@gmail.com>
```
a6081600
[Kernel][CPU] CPU MLA (#14744) · 4f044b1d
Thien Tran authored Mar 25, 2025
```
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
4f044b1d

Fix CUDA kernel index data type in... · 051da7ef

Lu Fang authored Mar 25, 2025

Fix CUDA kernel index data type in vllm/csrc/quantization/gptq_marlin/awq_marlin_repack.cu +10 (#15160)
Signed-off-by: Lu Fang <lufang@fb.com>
Co-authored-by: Richard Barnes <rbarnes@meta.com>

051da7ef

24 Mar, 2025 1 commit
- [Kernel] allow non-contiguous input for marlin kernel (#14658) · 6b3cc75b
  Jinzhen Lin authored Mar 24, 2025
```
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
```
  6b3cc75b
21 Mar, 2025 1 commit

Fix CUDA kernel index data type in... · d3ccbd63

Lu Fang authored Mar 20, 2025

Fix CUDA kernel index data type in vllm/csrc/quantization/fused_kernels/layernorm_utils.cuh +10 (#15159)
Signed-off-by: Lu Fang <lufang@fb.com>
Co-authored-by: Richard Barnes <rbarnes@meta.com>

d3ccbd63

18 Mar, 2025 2 commits
- [Misc][Docs] fix the comments of KV_T and CACHE_T in CALL_RESHAPE_AND_CACHE_XX macros (#14347) · 64fc2193
  Serena authored Mar 18, 2025
  
  64fc2193
- 解决PA部分size计算错误的问题 · ac811e51
  zhuwenwen authored Mar 18, 2025
```
优化bf16精度
解决bf16精度问题，解决cudagraph精度问题
```
  ac811e51
17 Mar, 2025 1 commit
- [MISC] More AMD unused var clean up (#14926) · cd0cd851
  Lu Fang authored Mar 17, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  cd0cd851
15 Mar, 2025 1 commit
- [CPU] Support FP8 KV cache (#14741) · a2ae4965
  Li, Jiang authored Mar 15, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  a2ae4965