Commits · dea49b156dae3ab83960e8ab23bc71b1d2e8ccaa · OpenDAS / vllm_cscc · GitLab

08 Aug, 2025 1 commit
- update fa full_cuda_graph support · 513f17a4
  zhuwenwen authored Aug 08, 2025
  
  513f17a4
07 Aug, 2025 1 commit
- [feat]支持mtp模型full_cuda_graph · a1239b53
  王敏 authored Aug 07, 2025
  
  a1239b53
01 Aug, 2025 2 commits
- 增加w4a8相关支持修改 · 2767fc34
  gaoqiong authored Aug 01, 2025
  
  2767fc34
- [fix]避免mla中cudagraph的适配影响非并行解码的逻辑 · 0e5d399a
  王敏 authored Aug 01, 2025
  
  0e5d399a
31 Jul, 2025 3 commits
- [feat]支持v1 engine mtp cudagraph · fe393be8
  王敏 authored Jul 31, 2025
  
  fe393be8
- update common.py · 3ae77d07
  zhuwenwen authored Jul 31, 2025
  
  3ae77d07
- update common.py · ef33478d
  zhuwenwen authored Jul 31, 2025
  
  ef33478d
24 Jul, 2025 2 commits
- support full_cuda_graph · 8da1c576
  zhuwenwen authored Jul 24, 2025
  
  8da1c576
- update fa v1 interface · f9408aff
  zhuwenwen authored Jul 24, 2025
  
  f9408aff
12 Jul, 2025 1 commit
- [fix]1.优化mtp代码，解决prefix-caching不兼容问题; 2.修复v1 engine从tokenizer config中读取max_model_len导致长文本输入报错 · b16f183c
  王敏 authored Jul 12, 2025
  
  b16f183c
07 Jul, 2025 4 commits
- 还原误删代码 · f0acced0
  王敏 authored Jul 07, 2025
  
  f0acced0
- 删掉无效代码 · ee9ee960
  王敏 authored Jul 07, 2025
  
  ee9ee960
- [feat]支持v1 engine flashmla和mtp同时开启 · ac4dedb1
  王敏 authored Jul 07, 2025
  
  ac4dedb1
- update vllm_flash_attn_varlen_func · ef6c0877
  zhuwenwen authored Jul 07, 2025
  
  ef6c0877
06 Jul, 2025 1 commit
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
05 Jul, 2025 1 commit
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
04 Jul, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
- update flash_attn.py · 4080ac85
  zhuwenwen authored Jul 04, 2025
  
  4080ac85
03 Jul, 2025 1 commit

[Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache... · 8d775dd3

Nicolò Lucchesi authored Jul 03, 2025


[Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache layout` warning (#20400)
Signed-off-by: NickLucche <nlucches@redhat.com>

8d775dd3

02 Jul, 2025 3 commits
- [ROCm][FEAT] Enable Full Graph Mode in AITER MLA V1 Attn Backend (Decode Phase only) (#20254) · a1aafc82
  vllmellm authored Jul 03, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  a1aafc82
- [TPU] kv cache update kernel supports dynamic grid (#20235) · 7da296be
  Chengji Yao authored Jul 01, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  7da296be
- [UT][intel GPU] use current_platform instead of device hardcode in v1 tests (#20169) · a0389e05
  Liangliang Ma authored Jul 02, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
  a0389e05
01 Jul, 2025 2 commits
- [CUDA graphs] Enable full cuda graphs with FA3 AoT scheduling (#20301) · 8acb4bad
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8acb4bad
- [BugFix][V1][ROCm] Triton MLA uses V0 backend on V1 engine (#19067) · 96453cfa
  TY-AMD authored Jul 01, 2025
```
Signed-off-by: Tianyuan Wu <Tianyuan.Wu@amd.com>
```
  96453cfa
27 Jun, 2025 1 commit
- Quick Fix by adding conditional import for flash_attn_varlen_func in flash_attn (#20143) · dec197e3
  Chendi.Xue authored Jun 27, 2025
```
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
```
  dec197e3
26 Jun, 2025 3 commits
- [TPU] add kv cache update kernel (#19928) · 04e1642e
  Chengji Yao authored Jun 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  04e1642e
- [Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560) · b69781f1
  Kunshang Ji authored Jun 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  b69781f1
- [Bugfix][V1][ROCm] Fix AITER Flash Attention Backend (Fix API Break and Local... · 27c065df
  TJian authored Jun 26, 2025
```
[Bugfix][V1][ROCm] Fix AITER Flash Attention Backend (Fix API Break and Local Attention Logic: affecting Llama4) (#19904)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  27c065df
25 Jun, 2025 3 commits
- [TPU] Add TPU specific var VLLM_TPU_MOST_MODEL_LEN (#19919) · 2d7620c3
  Chenyaaang authored Jun 25, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  2d7620c3
- [TPU][Bugfix] fix kv cache padding (#20048) · 2cc20699
  Chengji Yao authored Jun 25, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  2cc20699
- [BugFix] Fix full-cuda-graph illegal memory access in FA3 (#20057) · 0f9e7354
  Lucas Wilkinson authored Jun 25, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  0f9e7354
23 Jun, 2025 1 commit
- update common.py · 2da6fd72
  zhuwenwen authored Jun 23, 2025
  
  2da6fd72
20 Jun, 2025 1 commit
- [Bugfix] Enable PP with AITER+V1 (#19822) · e3a3e4db
  qli88 authored Jun 19, 2025
```
Signed-off-by: Qiang Li <qiang.li2@amd.com>
```
  e3a3e4db
19 Jun, 2025 1 commit
- [Misc] [ROCm] Prevent surplus tensor reshape (#19803) · aa20d10a
  zsolt-borbely-htec authored Jun 19, 2025
```
Signed-off-by: Zsolt Borbely <zsolt.borbely@htecgroup.com>
```
  aa20d10a
18 Jun, 2025 2 commits

[v1] Support mamba2 (#19327) · a89209b7
Chen Zhang authored Jun 19, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
a89209b7

[Hardware][AMD] integrate aiter chunked prefill into vllm (#18596) · 8b6e1d63

Zzz9990 authored Jun 18, 2025


Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: charlifu <charlifu@amd.com>
Co-authored-by: fsx950223 <fsx950223@outlook.com>
Co-authored-by: charlifu <charlifu@amd.com>

8b6e1d63

17 Jun, 2025 3 commits
- [Feature][ROCm] Add full graph capture support for TritonAttentionBackend (#19158) · a44b1c95
  Charlie Fu authored Jun 17, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  a44b1c95
- [V1][Kernel] Flashinfer HND KV cache layout (#19280) · 4c8f64fa
  Nicolò Lucchesi authored Jun 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  4c8f64fa
- Fixes IMA for TP w/ flex-attention (#19712) · ddfed314
  Driss Guessous authored Jun 16, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  ddfed314
16 Jun, 2025 1 commit
- [Bugfix] Fix TP inference for Flex attention backend (#19657) · 1173804d
  Isotr0py authored Jun 16, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  1173804d