Commits · 00e1335733802aaeb0a2a08d8cd3a0a93d7b0731 · OpenDAS / vllm_cscc

"...scripts/run-performance-benchmarks.sh" did not exist on "fb4f530bf5004a9afef1380cb0a84bfb98a89c63"

01 Aug, 2025 1 commit
- [feat]支持v1 engine mtp cudagraph · 00e13357
  zhuwenwen authored Aug 01, 2025
  
  00e13357
31 Jul, 2025 3 commits
- update unused code · 3de379de
  zhuwenwen authored Jul 31, 2025
  
  3de379de
- update List[int] and update num_rejected_tokens · f137e58c
  zhuwenwen authored Jul 31, 2025
  
  f137e58c
- update common.py · 0628e4b4
  zhuwenwen authored Jul 31, 2025
  
  0628e4b4
24 Jul, 2025 2 commits
- support full_cuda_graph · 8da1c576
  zhuwenwen authored Jul 24, 2025
  
  8da1c576
- update fa v1 interface · f9408aff
  zhuwenwen authored Jul 24, 2025
  
  f9408aff
21 Jul, 2025 1 commit

[Attention] Clean up iRoPE in V1 (#21188) · 304dce7e

Lucas Wilkinson authored Jul 21, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

304dce7e

20 Jul, 2025 1 commit
- [TPU] support fp8 kv cache quantization (#19292) · 3a1d8940
  Chengji Yao authored Jul 19, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  3a1d8940
19 Jul, 2025 3 commits
- [V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) · 752c6ade
  Woosuk Kwon authored Jul 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  752c6ade
- [BugFix] Fix potential cuda-graph IMA (#21196) · 59f93530
  Lucas Wilkinson authored Jul 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  59f93530
- [Core] Support Local Chunked Attention for Hybrid KV Cache (#19351) · 9a9fda14
  Lucia Fang authored Jul 19, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lu Fang <fanglu@meta.com>
```
  9a9fda14
18 Jul, 2025 2 commits
- [Attention] Make local attention backend agnostic (#21093) · 89cab4d0
  Lucas Wilkinson authored Jul 18, 2025
  
  89cab4d0
- [Bugfix] Fix the tensor non-contiguous issue for Flashinfer TRT-LLM backend... · 8dfb45ca
  elvischenv authored Jul 18, 2025
```
[Bugfix] Fix the tensor non-contiguous issue for Flashinfer TRT-LLM backend attention kernel (#21133)
```
  8dfb45ca
17 Jul, 2025 2 commits
- [Attention] Refactor attention metadata builder interface (#20466) · 76b49444
  Lucas Wilkinson authored Jul 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  76b49444
- Remove torch_xla.tpu.version() from pallas.py. (#21065) · 72ad2735
  QiliangCui authored Jul 16, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  72ad2735
16 Jul, 2025 3 commits
- [TPU] fix kv_cache_update kernel block size choosing logic (#21007) · 85431bd9
  Chengji Yao authored Jul 15, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  85431bd9
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
- [Nvidia] Integrate SM100 cudnn prefill API to MLA prefill (#20411) · 30800b01
  Elfie Guo authored Jul 15, 2025
```
Signed-off-by: Elfie Guo <elfieg@nvidia.com>
Co-authored-by: Elfie Guo <eflieg@nvidia.com>
```
  30800b01
15 Jul, 2025 2 commits
- [TPU] Optimize kv cache update kernel (#20415) · c586b556
  Yifei Teng authored Jul 15, 2025
```
Signed-off-by: Yifei Teng <tengyifei88@gmail.com>
```
  c586b556
- SM100 Cutlass MLA decode with unrestricted num_heads (< 128) for DeepSeek TP (#20769) · 8cdc3712
  Alexander Matveev authored Jul 14, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  8cdc3712
14 Jul, 2025 1 commit
- [Misc] Log the reason for falling back to FlexAttention (#20699) · e8cc53af
  Cyrus Leung authored Jul 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  e8cc53af
12 Jul, 2025 1 commit
- [fix]1.优化mtp代码，解决prefix-caching不兼容问题; 2.修复v1 engine从tokenizer config中读取max_model_len导致长文本输入报错 · b16f183c
  王敏 authored Jul 12, 2025
  
  b16f183c
11 Jul, 2025 3 commits
- [Core] Add Flashinfer TRTLLM Backend for Flashinfer decode path (SM100). (#19825) · 7bd4c37a
  Pavani Majety authored Jul 11, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: shuw <shuw@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  7bd4c37a
- [V1] Enable Mamba2 layers other than MambaMixer2 in the v1 engine (#20660) · 5d09152f
  nopperl authored Jul 11, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
  5d09152f
- [Attention] MLA - Flashinfer Ragged Prefill (#20034) · 5b032352
  Alexander Matveev authored Jul 10, 2025
  
  5b032352
09 Jul, 2025 2 commits

[Kernel] Triton implementation of causal-conv1d for Mamba-based models (#18218) · 47043eb6

Tuan, Hoang-Trong authored Jul 09, 2025


Signed-off-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

47043eb6

[Hardware][PPC64LE] Enable V1 for ppc64le and ARM (#20554) · 6db31e7a

Akash kaothalkar authored Jul 09, 2025


Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Nikhil Gupta <nikhil.gupta2@arm.com>

6db31e7a

08 Jul, 2025 2 commits
- [TPU] Temporary fix vmem oom for long model len by reducing page size (#20278) · e34d130c
  Chenyaaang authored Jul 07, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  e34d130c
- [CI/Build][CPU] Fix CPU CI and remove all CPU V0 files (#20560) · 7721ef17
  Li, Jiang authored Jul 08, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7721ef17
07 Jul, 2025 4 commits
- 还原误删代码 · f0acced0
  王敏 authored Jul 07, 2025
  
  f0acced0
- 删掉无效代码 · ee9ee960
  王敏 authored Jul 07, 2025
  
  ee9ee960
- [feat]支持v1 engine flashmla和mtp同时开启 · ac4dedb1
  王敏 authored Jul 07, 2025
  
  ac4dedb1
- update vllm_flash_attn_varlen_func · ef6c0877
  zhuwenwen authored Jul 07, 2025
  
  ef6c0877
06 Jul, 2025 1 commit
- [V1] Support any head size for FlexAttention backend (#20467) · 9fb52e52
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9fb52e52
05 Jul, 2025 1 commit
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
04 Jul, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
- update flash_attn.py · 4080ac85
  zhuwenwen authored Jul 04, 2025
  
  4080ac85
03 Jul, 2025 1 commit

[Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache... · 8d775dd3

Nicolò Lucchesi authored Jul 03, 2025


[Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache layout` warning (#20400)
Signed-off-by: NickLucche <nlucches@redhat.com>

8d775dd3

02 Jul, 2025 2 commits
- [ROCm][FEAT] Enable Full Graph Mode in AITER MLA V1 Attn Backend (Decode Phase only) (#20254) · a1aafc82
  vllmellm authored Jul 03, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  a1aafc82
- [TPU] kv cache update kernel supports dynamic grid (#20235) · 7da296be
  Chengji Yao authored Jul 01, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  7da296be