Commits · 31a3beb588d29fcc6badae8646cfb53d449d829b · OpenDAS / vllm_cscc · GitLab

17 Dec, 2025 1 commit
- update flash_mla_with_kvcache_fp8 interface and k_cache · 77210184
  zhuwenwen authored Dec 17, 2025
  
  77210184
16 Dec, 2025 1 commit
- add VLLM_USE_FLASH_MLA_FP8 to use mla fp8 · a9f57e73
  zhuwenwen authored Dec 16, 2025
```
set VLLM_USE_LIGHTOP_RMS_ROPE_CONCAT=1
```
  a9f57e73
07 Dec, 2025 1 commit
- sync flashmla get_mla_metadata · 62420b27
  zhuwenwen authored Dec 07, 2025
  
  62420b27
23 Nov, 2025 1 commit
- add VLLM_USE_CAT_MLA to use fused cat and mla · 4b00d1ba
  zhuwenwen authored Nov 23, 2025
  
  4b00d1ba
13 Oct, 2025 1 commit
- 新增fp8—e5m2 · ed3cdc81
  zhuwenwen authored Oct 13, 2025
  
  ed3cdc81
13 Sep, 2025 1 commit
- add VLLM_USE_MERGE_ATTN_STATES_OPT to control merge_attn_states support · 2071c380
  zhuwenwen authored Sep 13, 2025
  
  2071c380
10 Sep, 2025 1 commit
- add rocm merge_attn_states · f6324f60
  zhuwenwen authored Sep 10, 2025
  
  f6324f60
21 Aug, 2025 1 commit
- revert 修改flashmla的接口 · 9b67a1e0
  zhuwenwen authored Aug 21, 2025
  
  9b67a1e0
15 Aug, 2025 2 commits
- 修改flashmla的接口 · 299df36d
  yangql authored Aug 15, 2025
  
  299df36d
- 增加marlin对cache13的支持，以及新增flash mla的kvcache fp8的支持 · 8f25283a
  yangql authored Aug 15, 2025
  
  8f25283a
03 Jul, 2025 1 commit
- update VLLM_USE_FLASH_ATTN_BACKEND to VLLM_USE_FLASH_ATTN_PA · e036115e
  zhuwenwen authored Jul 03, 2025
  
  e036115e
02 Jul, 2025 1 commit
- [TPU] kv cache update kernel supports dynamic grid (#20235) · 7da296be
  Chengji Yao authored Jul 01, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  7da296be
27 Jun, 2025 1 commit
- update cutlass fa and pa · 4ddb5447
  zhuwenwen authored Jun 27, 2025
  
  4ddb5447
26 Jun, 2025 1 commit
- [TPU] add kv cache update kernel (#19928) · 04e1642e
  Chengji Yao authored Jun 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  04e1642e
25 Jun, 2025 1 commit
- [Refactor] Remove duplicate `ceil_div` (#20023) · 879f69be
  Wentao Ye authored Jun 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  879f69be
20 Jun, 2025 1 commit
- [Kernel] correct cpu worker function parameter type (#19745) · 71d12195
  Ning Xie authored Jun 20, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  71d12195
18 Jun, 2025 2 commits
- release opt1 · 1a280da1
  zhuwenwen authored Jun 18, 2025
  
  1a280da1
- [MISC] correct copy_blocks src_to_dists param type (#19696) · c53711bd
  Ning Xie authored Jun 18, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c53711bd
17 Jun, 2025 1 commit
- [Kernel] Add Split-KV Support to Unified Triton Attention Kernel (#19152) · ccd7c050
  jvlunteren authored Jun 17, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
```
  ccd7c050
11 Jun, 2025 1 commit
- [Misc] Fix misleading ROCm warning (#19486) · 04a55612
  Jee Jee Li authored Jun 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  04a55612
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
29 May, 2025 2 commits
- [ROCm][V0][Attention] Revert to the previous FA triton kernel (#18226) · 1b7cfd5a
  Gregory Shtrasberg authored May 29, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  1b7cfd5a
- [Attention][V1] Toggle for v1 attention backend (#18275) · da4b69d0
  Gregory Shtrasberg authored May 29, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  da4b69d0
28 May, 2025 1 commit

[Bugfix][ROCm] fix the power of 2 exception from triton_unified_attention.py... · 269d9017

Hongxia Yang authored May 28, 2025


[Bugfix][ROCm] fix the power of 2 exception from triton_unified_attention.py when running llama4 models and unit test fix (#18100)
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

269d9017

21 May, 2025 1 commit
- [ROCm][Kernel][V1] Enable AMD Radeon GPU Custom Paged Attention on v1 (#17004) · dd5fa7e0
  Hosang authored May 21, 2025
```
Signed-off-by: Hosang Yoon <hosang.yoon@amd.com>
```
  dd5fa7e0
20 May, 2025 2 commits
- [Kernel] update comment for KV shape in unified triton attn (#18099) · 980a1724
  Percy authored May 20, 2025
```
Signed-off-by: haochengxia <xhc_1007@163.com>
```
  980a1724
- support Z100L and K100 inference · a5aa55e8
  zhuwenwen authored May 20, 2025
  
  a5aa55e8
19 May, 2025 1 commit
- 增加PA_TC kv cache int8/fp8支持 · e02d110d
  zhangshao authored May 19, 2025
  
  e02d110d
15 May, 2025 2 commits
- [Kernel] [V1] Fix performance regression for triton unified attention (#18161) · 01c22335
  Thomas Parnell authored May 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  01c22335
- [Bugfix] Fix fp8 tests for triton_unified_attention for Triton 3.3 (#18013) · e6b8e65d
  Thomas Parnell authored May 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  e6b8e65d
14 May, 2025 3 commits
- add kvint8 · 6d105cc4
  xiabo authored May 14, 2025
  
  6d105cc4
- [BugFix][AMD] Compatible patch for AITER lib after 04/20 (#17912) · 4f8b3732
  qli88 authored May 14, 2025
```
Signed-off-by: Qiang Li <qiang.li2@amd.com>
```
  4f8b3732
- add kvint8 · 45273722
  xiabo authored May 14, 2025
  
  45273722
11 May, 2025 1 commit
- [FP8][ROCm][Attention] Enable FP8 KV cache on ROCm for V1 (#17870) · 06c0922a
  Gregory Shtrasberg authored May 11, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  06c0922a
09 May, 2025 3 commits
- Revert "[BugFix][AMD] Compatible patch for latest AITER(05/07/2025)" (#17910) · 85b72cb7
  Michael Goin authored May 09, 2025
  
  85b72cb7
- [BugFix][AMD] Compatible patch for latest AITER(05/07/2025) (#17864) · 9f64e934
  qli88 authored May 09, 2025
```
Signed-off-by: Qiang Li <qiang.li2@amd.com>
```
  9f64e934
- [FEAT][ROCm]: Support AITER MLA on V1 Engine (#17523) · 3c9396a6
  vllmellm authored May 09, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: qli88 <qiang.li2@amd.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
```
  3c9396a6
08 May, 2025 1 commit
- [Hardware][Intel-Gaudi] Support Automatic Prefix Caching on HPU (#17648) · 843b2227
  Agata Dobrzyniewicz authored May 08, 2025
```
Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>
```
  843b2227
06 May, 2025 2 commits
- [Kernel] Unified Triton kernel that doesn't distinguish between prefill + decode (#16828) · 2f925e57
  Thomas Parnell authored May 06, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  2f925e57
- [Bugfix] Fix triton import with local TritonPlaceholder (#17446) · f9bc5a06
  Mengqing Cao authored May 06, 2025
```
Signed-off-by: Mengqing Cao <cmq0113@163.com>
```
  f9bc5a06