Commits · 66e674cdd549e89b341fb33405a2c02ec5f5ae8d · OpenDAS / vllm_cscc

05 Dec, 2025 1 commit

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315) · 66e674cd

Matthew Bonanni authored Dec 05, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

66e674cd

27 Nov, 2025 1 commit
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
26 Nov, 2025 1 commit
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
24 Nov, 2025 1 commit
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
22 Nov, 2025 1 commit
- [Attention] Refactor FA `block_size` limitations to hybrid models only (#29084) · 066209a0
  Nicolò Lucchesi authored Nov 22, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  066209a0
21 Nov, 2025 1 commit
- [Attention] Add ROCM_AITER_MLA_SPARSE to attention backend registry (#29103) · 11857a00
  Matthew Bonanni authored Nov 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  11857a00
20 Nov, 2025 2 commits
- [KVConnector][Core] Support cross-layer KV blocks (#27743) · 64746471
  Or Ozeri authored Nov 20, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  64746471
- [AMD] Use Decoupled Kernel Block Size to Support AITER MLA block_size=1 (#27715) · 3fb0d909
  Qiang Zhang authored Nov 20, 2025
```
Signed-off-by: chiangzhang <chiangzhang@tencent.com>
```
  3fb0d909
19 Nov, 2025 3 commits

[Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4

Qiu authored Nov 20, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>

2fd893b4

Upstreaming aiter triton attention backend as a new backend (#28701) · ac10fd3c
Aleksandr Malyshev authored Nov 19, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
ac10fd3c

[Model][Mamba] Add selector for mamba attention backend and make it pluggable... · d44e9df7

Shanshan Shen authored Nov 20, 2025


[Model][Mamba] Add selector for mamba attention backend and make it pluggable for other device (#26487)
Signed-off-by: shen-shanshan <467638484@qq.com>

d44e9df7

13 Nov, 2025 1 commit
- [CI Failure] Fix backend selection for encoder-only models (#28534) · 07a606aa
  Huamin Li authored Nov 13, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  07a606aa
12 Nov, 2025 1 commit
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
11 Nov, 2025 1 commit

[Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03

Matthew Bonanni authored Nov 11, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

b30dfa03

10 Nov, 2025 1 commit
- [V0 deprecation] Remove no longer used `get_metadata_cls` (#28370) · e8697faf
  Lucas Wilkinson authored Nov 10, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e8697faf
17 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
16 Oct, 2025 1 commit
- [Feature] Add process_weights_after_loading to AttentionImpl (#26870) · 5afd3276
  rongfu.leng authored Oct 16, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  5afd3276
15 Oct, 2025 1 commit

Move query quantization to attention layer for Flashinfer & Triton. (#26534) · 0a9ef0cf

Adrian Abeyta authored Oct 15, 2025


Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Adrian Abeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

0a9ef0cf

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 2 commits

[Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486) · d24cf322
Zhiyuan Li authored Oct 09, 2025
```
Signed-off-by: lizhiyuan <uniartisan2017@gmail.com>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>
```
d24cf322

Separate MLAAttention class from Attention (#25103) · e614ab78

Naveenraj Kamalakannan authored Oct 08, 2025

Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

e614ab78

08 Oct, 2025 2 commits
- [Attention] Register FLASHMLA_SPARSE (#26441) · 2a03f93d
  Matthew Bonanni authored Oct 08, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2a03f93d
- [Attention] Implement universal BACKEND_MAP (#25900) · 76879cc1
  Matthew Bonanni authored Oct 08, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  76879cc1
06 Oct, 2025 1 commit
- [ROCm] Split AITER unified attention into its own backend (#25507) · f231e5bc
  Gregory Shtrasberg authored Oct 06, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  f231e5bc
05 Oct, 2025 2 commits
- Fix per file ruff ignores related to typing (#26254) · 1c0c6820
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1c0c6820
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
03 Oct, 2025 1 commit
- [Attention] Move Backend enum into registry (#25893) · 2aaa4238
  Matthew Bonanni authored Oct 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2aaa4238
30 Sep, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

25 Sep, 2025 1 commit
- [torch.compile] Make Query Quantization Fusable (#24914) · 69a8c8e9
  Jonas M. Kübler authored Sep 25, 2025
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  69a8c8e9
24 Sep, 2025 2 commits
- [V0 Deprecation] Remove unused classes in attention (#25541) · e6750d0b
  Woosuk Kwon authored Sep 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  e6750d0b
- [V0 Deprecation] Remove max_seq_len_to_capture (#25543) · 2e19a848
  Woosuk Kwon authored Sep 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2e19a848
23 Sep, 2025 1 commit
- [V0 Deprecation] Remove placeholder attn (#25510) · 969b4da3
  Thomas Parnell authored Sep 24, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  969b4da3
22 Sep, 2025 2 commits
- [Misc] Remove unused encoder-decoder error strings (#25374) · 417a164a
  Cyrus Leung authored Sep 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  417a164a
- [V0 Deprecation] Remove `MultiModalPlaceholderMap` (#25366) · f92d9526
  Cyrus Leung authored Sep 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f92d9526
21 Sep, 2025 3 commits
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
- [V0 Deprecation] Remove V0 model runner base & simplify worker base (#25328) · 1cd885bd
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1cd885bd
- [V0 Deprecation] Remove V0 core (#25321) · c99db8c8
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c99db8c8
19 Sep, 2025 1 commit
- Encoder model support for the Transformers backend (#25174) · 12aed7e4
  Harry Mellor authored Sep 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  12aed7e4
16 Sep, 2025 1 commit
- [Bug] Fix `is_flashmla_supported` Check Error (#24774) · b42566f4
  Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b42566f4
12 Sep, 2025 1 commit
- [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705) · 7ba32aa6
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  7ba32aa6