Commits · a28b94e6ef60b7f5aa1b97bc8d966a8d12cbc1da · OpenDAS / vllm_cscc

24 Jan, 2026 1 commit

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

22 Jan, 2026 1 commit

Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141) · 44f08af3

Eldar Kurtić authored Jan 22, 2026


Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
Signed-off-by: eldarkurtic <8884008+eldarkurtic@users.noreply.github.com>

44f08af3

18 Jan, 2026 1 commit
- [Model] Support Step1 Model (#32511) · c826c72a
  Li Xie authored Jan 18, 2026
```
Signed-off-by: xieli <xieli@stepfun.com>
```
  c826c72a
15 Jan, 2026 1 commit
- [Misc] Remove redundant line (#32366) · d86fc23b
  Li Wang authored Jan 15, 2026
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  d86fc23b
09 Jan, 2026 3 commits
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
- [Doc] Add developer guide for CustomOp (#30886) · 08d954f0
  Shanshan Shen authored Jan 10, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  08d954f0
- [Bugfix][ROCm]Fix Qwen3-Next-80B-A3B-Thinking inference and optimize... · 1a19e9cd
  vllmellm authored Jan 09, 2026
```
[Bugfix][ROCm]Fix Qwen3-Next-80B-A3B-Thinking inference and optimize non-standard block size (544) support under rocm_atten (#31380)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  1a19e9cd
08 Jan, 2026 4 commits
- [Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues... · 6cdf015c
  Lucas Wilkinson authored Jan 08, 2026
```
[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues in the future (#31747)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  6cdf015c
- [MM Encoder]: Make MMEncoderAttention's `scale` takes effect properly (#31950) · 2972a054
  Isotr0py authored Jan 08, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2972a054
- fix(rocm): add early return in get_flash_attn_version for ROCm (#31286) · 39d82005
  Rabi Mishra authored Jan 08, 2026
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  39d82005
- [0/N][Attention] Fix miscellaneous pre-commit issues (#31924) · 0d766741
  Matthew Bonanni authored Jan 07, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  0d766741
07 Jan, 2026 4 commits

[Chore] Migrate V0 attention utils (#31891) · b665bbc2
Cyrus Leung authored Jan 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
b665bbc2

[Misc] Improve error messages for unsupported types and parameters (#30593) · 0790f076

BlankR authored Jan 07, 2026


Signed-off-by: BlankR <hjyblanche@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

0790f076

[Refactor][TPU] Remove torch_xla path and use tpu-inference (#30808) · e7596371

weiyu authored Jan 07, 2026


Signed-off-by: Wei-Yu Lin <weiyulin@google.com>
Signed-off-by: weiyu <62784299+weiyu0824@users.noreply.github.com>

e7596371

fixed mypy warnings for files vllm/v1/attention with TEMPORARY workaround (#31465) · 0a2c2dc3

Jack Yang authored Jan 06, 2026


Signed-off-by: Zhuohao Yang <zy242@cornell.edu>
Co-authored-by: Zhuohao Yang <zy242@cornell.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

0a2c2dc3

06 Jan, 2026 1 commit
- [Bugfix]: Fix cross attention backend selection for Turing GPU (#31806) · 02809af1
  Isotr0py authored Jan 06, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  02809af1
05 Jan, 2026 1 commit
- [v1] Add encoder-only/cross attention support to Triton Attention backend (#31406) · 6aa5b18e
  Isotr0py authored Jan 06, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  6aa5b18e
02 Jan, 2026 1 commit
- [MoE] Fix output_shape calculation in Attention layer to handle 3D query inputs (#31596) · 6ef770df
  Andreas Karatzas authored Jan 02, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  6ef770df
30 Dec, 2025 1 commit

[Model] Add support for openPangu moe model (#28775) · 3f52fa5a

yt0428 authored Dec 31, 2025


Signed-off-by: yuantao <2422264527@qq.com>
Signed-off-by: yt0428 <51468697+yt0428@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3f52fa5a

28 Dec, 2025 1 commit
- [BugFix] register quant scale tensors as buffer (#31395) · 62def07d
  Boyuan Feng authored Dec 27, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  62def07d
23 Dec, 2025 1 commit
- [ROCm][Bugfix] Fix RuntimeError in MMEncoderAttention by replacing .view() with .reshape() (#31203) · bfa2c0bb
  Andreas Karatzas authored Dec 23, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  bfa2c0bb
22 Dec, 2025 1 commit
- [Misc] Fix grammar errors in comments and messages (#31115) · 42b42824
  Kevin McKay authored Dec 21, 2025
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
  42b42824
20 Dec, 2025 1 commit

[Bugfix] fix the alias bug of AttentionBackendEnum when register CUSTOM... · d52c5096

zejunchen-zejun authored Dec 20, 2025


[Bugfix] fix the alias bug of AttentionBackendEnum when register CUSTOM attention backend to vllm (#30869)
Signed-off-by: zejunchen-zejun <zejun.chen@amd.com>

d52c5096

19 Dec, 2025 2 commits
- [Bugfix] [Kernel] Triton attention kernels: mask out V blocks that fall... · b5545d9d
  Thomas Parnell authored Dec 19, 2025
```
[Bugfix] [Kernel] Triton attention kernels: mask out V blocks that fall outside sliding window (#30887)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  b5545d9d
- [Bugfix] Fix incorrect tiles creation for mm prefix triton attention (#30974) · ac1c9342
  Isotr0py authored Dec 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  ac1c9342
18 Dec, 2025 4 commits
- [Bugfix] Remove `tile_size=64` for mm_prefix triton attention (#30973) · d2dc5dfc
  Isotr0py authored Dec 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d2dc5dfc
- [MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new... · 700a5ad6
  Isotr0py authored Dec 19, 2025
```
[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new `MMEncoderAttention` interface (#30684)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  700a5ad6
- [ROCm][Bugfix] Fix `fa_version` argument error in... · 8da6ae49
  Andreas Karatzas authored Dec 18, 2025
```
[ROCm][Bugfix] Fix `fa_version` argument error in `flash_attn_maxseqlen_wrapper` for ROCm without aiter (#30909)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  8da6ae49
- [v1] Add PrefixLM support to TritonAttention backend (#30386) · 74a1ac38
  Isotr0py authored Dec 18, 2025
  
  74a1ac38
17 Dec, 2025 1 commit
- chores: adjust the attn register param order (#30688) · 6482e389
  Hank_ authored Dec 17, 2025
```
Signed-off-by: Hank <hcc.mayday@gmail.com>
```
  6482e389
16 Dec, 2025 3 commits
- [MM] Pass FA version in ViT Attn (#30756) · e087fbc3
  Nicolò Lucchesi authored Dec 17, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  e087fbc3
- [ROCm] [Bugfix] Fix torch sdpa hallucination (#30789) · 2410132b
  TJian authored Dec 17, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  2410132b
- [Attention] Cache attention metadata builds across hybrid KV-cache groups (#29627) · 9fec0e13
  Lucas Wilkinson authored Dec 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
  9fec0e13
15 Dec, 2025 3 commits

[Bugfix] Fix ViT with FlashAttention on ROCm (#30703) · 51e5b3e3
Matthew Bonanni authored Dec 15, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
51e5b3e3

[Platform] Refactor Platform attention backend selection to avoid breakpoint... · ec154c36

Isotr0py authored Dec 16, 2025


[Platform] Refactor Platform attention backend selection to avoid breakpoint for OOT platform (#30212)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ec154c36

[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend... · 87b4d155

Shanshan Shen authored Dec 15, 2025


[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend of QwenVisionAttention with it. (#30125)
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

87b4d155

13 Dec, 2025 1 commit
- [Bugfix] Pass FA version in `MultiHeadAttention` (#30575) · 86a32615
  Matthew Bonanni authored Dec 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  86a32615
12 Dec, 2025 1 commit

[Kernel] Support CUDA Graphs in 3D Triton Attention Kernel (#28306) · 9c0ee995

jvlunteren authored Dec 12, 2025


Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
Signed-off-by: jvlunteren <161835099+jvlunteren@users.noreply.github.com>
Co-authored-by: Thomas Parnell <tom.parnell@gmail.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>

9c0ee995

11 Dec, 2025 2 commits
- [Misc][PCP&DCP] relocate PCP feature check (#30050) · a11f4a81
  Qiu authored Dec 11, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a11f4a81
- [Deprecation] Remove deprecated plugin and compilation fields for v0.13 release (#30396) · 5a87d8b9
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a87d8b9