Commits · d805c59c2ab5c5abb6ee108f7bdd28cdcc01b615 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "bcefce6a814c2c1228e25fcd98c88fea9e8111a9"

10 Jul, 2025 1 commit
- update bw vdim128 · d805c59c
  zhuwenwen authored Jul 10, 2025
  
  d805c59c
09 Jul, 2025 1 commit
- [fix]修复零消耗引入的cudagraph模式数据准备cpu耗时问题 · cd6239dc
  zhuwenwen authored Jul 09, 2025
  
  cd6239dc
03 Jul, 2025 1 commit
- update VLLM_USE_FLASH_ATTN_BACKEND to VLLM_USE_FLASH_ATTN_PA · e036115e
  zhuwenwen authored Jul 03, 2025
  
  e036115e
27 Jun, 2025 1 commit
- update cutlass fa and pa · 4ddb5447
  zhuwenwen authored Jun 27, 2025
  
  4ddb5447
23 Jun, 2025 1 commit
- update common.py · 2da6fd72
  zhuwenwen authored Jun 23, 2025
  
  2da6fd72
21 Jun, 2025 1 commit
- only K100_AI can use cutlass prefix cache · 14945681
  zhuwenwen authored Jun 21, 2025
  
  14945681
13 Jun, 2025 1 commit
- update triton_mla.py · e046b382
  zhuwenwen authored Jun 13, 2025
  
  e046b382
06 Jun, 2025 1 commit
- [Model] Add VLLM_USE_NN to use nn layout · 6880bf15
  zhuwenwen authored Jun 06, 2025
  
  6880bf15
04 Jun, 2025 1 commit
- [CPU] V1 support for the CPU backend (#16441) · 4555143e
  Li, Jiang authored Jun 04, 2025
  
  4555143e
03 Jun, 2025 2 commits
- [V1] Support cross-layer KV sharing (#18212) · bdf13965
  Yong Hoon Shin authored Jun 03, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  bdf13965
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
30 May, 2025 2 commits
- [ROCm] Remove unnecessary assertion of max_model_len in ROCM_AITER_MLA attention backend. (#18938) · 77b6e74f
  vllmellm authored May 30, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  77b6e74f
- update flash_attn.py · 58042164
  zhuwenwen authored May 30, 2025
  
  58042164
29 May, 2025 2 commits
- [ROCm][V0][Attention] Revert to the previous FA triton kernel (#18226) · 1b7cfd5a
  Gregory Shtrasberg authored May 29, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  1b7cfd5a
- [test]fix basic_correctness and benchmarks · dbd62f84
  zhuwenwen authored May 29, 2025
  
  dbd62f84
28 May, 2025 4 commits
- update use_rocm_custom_paged_attention · df877aad
  zhuwenwen authored May 28, 2025
  
  df877aad
- [BugFix] FA2 MLA Accuracy Issue (#18807) · ce75efee
  Lucas Wilkinson authored May 28, 2025
```
Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>
```
  ce75efee
- set VLLM_FLASH_ATTN_BACKEND to use FlashAttention Backend for attention computation on rocm · 82f60bef
  zhuwenwen authored May 28, 2025
  
  82f60bef
- using triton prefix cache on BW · 07b41ddf
  zhuwenwen authored May 28, 2025
  
  07b41ddf
23 May, 2025 2 commits
- tbo增加ds int8支持，修改tb zerooverhead环境变量到envs.py中统一管理 · dbbb148b
  lizhigong authored May 23, 2025
  
  dbbb148b
- 修改MLA prefill阶段出现的Device2Host拷贝同步现象。 · 3f80d9ac
  lizhigong authored May 22, 2025
  
  3f80d9ac
22 May, 2025 1 commit
- 修改MLA prefill阶段出现的Device2Host拷贝同步现象 · 0c1fa562
  zhuwenwen authored May 22, 2025
  
  0c1fa562
21 May, 2025 1 commit
- [ROCm][Kernel][V1] Enable AMD Radeon GPU Custom Paged Attention on v1 (#17004) · dd5fa7e0
  Hosang authored May 21, 2025
```
Signed-off-by: Hosang Yoon <hosang.yoon@amd.com>
```
  dd5fa7e0
20 May, 2025 1 commit
- support Z100L and K100 inference · a5aa55e8
  zhuwenwen authored May 20, 2025
  
  a5aa55e8
14 May, 2025 2 commits
- [BugFix][AMD] Compatible patch for AITER lib after 04/20 (#17912) · 4f8b3732
  qli88 authored May 14, 2025
```
Signed-off-by: Qiang Li <qiang.li2@amd.com>
```
  4f8b3732
- [Fix] Support CUDAGraph capture for encoder-decoder on ROCm (#18104) · 176a95c6
  Luka Govedič authored May 13, 2025
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
```
  176a95c6
13 May, 2025 2 commits
- support cutlass prefix-cache · bdc70899
  zhuwenwen authored May 13, 2025
  
  bdc70899
- Implements dual-chunk-flash-attn backend for dual chunk attention with sparse... · 60f76243
  Tao He authored May 13, 2025
```
Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)
```
  60f76243
11 May, 2025 1 commit
- fix amd triton mla path (#17871) · eea22a56
  Shiyan Deng authored May 11, 2025
  
  eea22a56
09 May, 2025 4 commits
- Revert "[BugFix][AMD] Compatible patch for latest AITER(05/07/2025)" (#17910) · 85b72cb7
  Michael Goin authored May 09, 2025
  
  85b72cb7
- [BugFix][AMD] Compatible patch for latest AITER(05/07/2025) (#17864) · 9f64e934
  qli88 authored May 09, 2025
```
Signed-off-by: Qiang Li <qiang.li2@amd.com>
```
  9f64e934
- [Attention] MLA move rotary embedding to cuda-graph region (#17668) · 5e6f9394
  Lucas Wilkinson authored May 08, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  5e6f9394
- debug v0 zero overhead schedule · 4ff58b66
  lizhigong authored Apr 14, 2025
  
  4ff58b66
08 May, 2025 1 commit
- [Hardware][Intel-Gaudi] Support Automatic Prefix Caching on HPU (#17648) · 843b2227
  Agata Dobrzyniewicz authored May 08, 2025
```
Signed-off-by: Agata Dobrzyniewicz <adobrzyniewicz@habana.ai>
```
  843b2227
07 May, 2025 1 commit
- [TPU] Add kernel test for moe_pallas (#17496) · e50a1f1a
  Michael Goin authored May 06, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e50a1f1a
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
02 May, 2025 2 commits

[Core] [Bugfix] Add Input Embeddings (#15428) · cc2a77d7

Andrew Sansom authored May 02, 2025


Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: 临景 <linjing.yx@alibaba-inc.com>
Co-authored-by: Bryce1010 <bryceyx@gmail.com>
Co-authored-by: Nan2018 <nan@protopia.ai>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

cc2a77d7

[Attention] MLA move o_proj q_proj into cuda-graph region (#17484) · afcb3f88
Lucas Wilkinson authored May 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
afcb3f88

01 May, 2025 1 commit
- [BugFix] Fix mla cpu - missing 3 required positional arguments (#17494) · 3c3d7672
  Lucas Wilkinson authored May 01, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  3c3d7672
30 Apr, 2025 1 commit
- skip is_rocm_aiter_moe_enabled and add mla pad · daefd764
  zhuwenwen authored Apr 30, 2025
  
  daefd764