Commits · a99564ac5b2bc86d97cb18a7e18086b4ba94466a · OpenDAS / vllm_cscc

25 Oct, 2025 1 commit
- [Attention] Add missing kv cache scale setup (#27490) · a99564ac
  Matthew Bonanni authored Oct 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a99564ac
23 Oct, 2025 1 commit

[Bugfix] Honor --mm_encoder_attn_backend when used (#27124) · 570c3e1c

Bradley D authored Oct 23, 2025


Co-authored-by: Bradley D <4551889+bradleyhd@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

570c3e1c

21 Oct, 2025 1 commit
- [MM][Core] Decouple ViT backend from LM backend (#27061) · c3a2c6ac
  Roger Wang authored Oct 21, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  c3a2c6ac
18 Oct, 2025 2 commits
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
- [Misc] Refactor `get_kv_cache_spec` into `AttentionLayerBase` (#26587) · b26b70be
  Nicolò Lucchesi authored Oct 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  b26b70be
17 Oct, 2025 1 commit
- [Minor] Remove unnecessary error message (#27115) · d29483b5
  Zhuohan Li authored Oct 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  d29483b5
16 Oct, 2025 1 commit
- [Feature] Add process_weights_after_loading to AttentionImpl (#26870) · 5afd3276
  rongfu.leng authored Oct 16, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  5afd3276
15 Oct, 2025 2 commits
- Move query quantization to attention layer for Flashinfer & Triton. (#26534) · 0a9ef0cf
  Adrian Abeyta authored Oct 15, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
Signed-off-by: Adrian Abeyta <aabeyta@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  0a9ef0cf
- [DSA][MLA] Tiny refactor on DeepSeek to make it reusable for different backends (#26656) · 302ef403
  Mengqing Cao authored Oct 15, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  302ef403
14 Oct, 2025 2 commits

[torch.compile] Fix tests for torch==2.9 inductor partition (#26116) · 2dcd12d3
Luka Govedič authored Oct 14, 2025
```
Signed-off-by: ProExpertProg <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
```
2dcd12d3

remove attn output view kernel (#26680) · a86b4c58

Boyuan Feng authored Oct 14, 2025

Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

a86b4c58

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit

Separate MLAAttention class from Attention (#25103) · e614ab78

Naveenraj Kamalakannan authored Oct 08, 2025

Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

e614ab78

08 Oct, 2025 1 commit
- [Attention] Implement universal BACKEND_MAP (#25900) · 76879cc1
  Matthew Bonanni authored Oct 08, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  76879cc1
05 Oct, 2025 2 commits
- Fix per file ruff ignores related to typing (#26254) · 1c0c6820
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  1c0c6820
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit
- [Model] CLIP Embedding Support (#26010) · 4570535e
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4570535e
03 Oct, 2025 2 commits
- [ROCm] [VL] [Bugfix] Fix vit flash attn dispatcher logic for ROCm (#26104) · 9c5ee91b
  TJian authored Oct 02, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  9c5ee91b
- [Attention] Move Backend enum into registry (#25893) · 2aaa4238
  Matthew Bonanni authored Oct 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2aaa4238
30 Sep, 2025 2 commits

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

Move`VllmConfig` from `config/__init__.py` to `config/vllm.py` (#25271) · 61aedb5f
Harry Mellor authored Sep 30, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
61aedb5f

29 Sep, 2025 1 commit
- [BugFix][torch.compile] KV scale calculation issues with FP8 quantization (#25513) · c42ff4f4
  Adrian Abeyta authored Sep 29, 2025
```
Signed-off-by: adabeyta <aabeyta@redhat.com>
```
  c42ff4f4
25 Sep, 2025 2 commits
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
- [torch.compile] Make Query Quantization Fusable (#24914) · 69a8c8e9
  Jonas M. Kübler authored Sep 25, 2025
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  69a8c8e9
23 Sep, 2025 2 commits
- Remove redundant mutates_args and dispatch_key for direct_register_custom_op (#25512) · 7361ab37
  Michael Goin authored Sep 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  7361ab37
- [V0 Deprecation] Remove placeholder attn (#25510) · 969b4da3
  Thomas Parnell authored Sep 24, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  969b4da3
20 Sep, 2025 2 commits

[BUG FIX][NON-CUDA]quick fix to avoid call cudagraph_unsafe in attention (#25298) · 6c5f82e5
Chendi.Xue authored Sep 19, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
6c5f82e5

[torch.compile] CUDAGraph Inductor partition integration (#24281) · 8945b001

Boyuan Feng authored Sep 19, 2025


Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Boyuan Feng <fby.1994@gmail.com>
Signed-off-by: boyuanfeng <boyuan@meta.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

8945b001

19 Sep, 2025 1 commit
- [bugfix] fix MHA for models like OpenGVLab/InternVL3_5-38B (#25146) · a684c012
  Yan Ma authored Sep 19, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a684c012
18 Sep, 2025 1 commit
- [XPU] Whisper model support on XPU Platform (#25123) · 3bc18127
  Chaojun Zhang authored Sep 18, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  3bc18127
15 Sep, 2025 1 commit
- [USAGE] Improve error handling for weight initialization in Unquantized… (#20321) · b834b4cb
  Rafael Marcelino Koike authored Sep 15, 2025
```
Signed-off-by: Rafael Marcelino Koike <rafael.koike@oracle.com>
Signed-off-by: Rafael Koike <koike.rafael@gmail.com>
```
  b834b4cb
12 Sep, 2025 1 commit
- [Multi Modal] Add FA3 in VIT (#24347) · 72fc8aa4
  Wenlong Wang authored Sep 12, 2025
```
Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
```
  72fc8aa4
11 Sep, 2025 1 commit
- [Bugfix] Add missing VIT backend dispatch on CPU (#24623) · 29799dda
  Li, Jiang authored Sep 11, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  29799dda
10 Sep, 2025 1 commit

Feature/vit attention unification# 23880 (#23978) · 6cbd4190

baonudesifeizhai authored Sep 10, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

6cbd4190

27 Aug, 2025 1 commit
- [XPU] Add xpu torch.compile support (#22609) · fce10dbe
  Kunshang Ji authored Aug 27, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  fce10dbe
25 Aug, 2025 1 commit
- [Attention] Unify mamba and attention backend selection (#23171) · 5c4b6e66
  Ayush Satyam authored Aug 25, 2025
```
Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>
```
  5c4b6e66
22 Aug, 2025 1 commit

[NVIDIA][torch.compile] Support Flashinfer TRTLLM FP8-q/kv NVFP4-out Attention Kernel (#22703) · 24d0c9e6

elvischenv authored Aug 23, 2025


Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

24d0c9e6

19 Aug, 2025 1 commit

[NVIDIA] Support Flashinfer TRTLLM FP8-q/kv/out Attention Kernel (#21716) · 03752dba

elvischenv authored Aug 19, 2025

Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

03752dba

16 Aug, 2025 1 commit
- [Bugfix gpt-oss] Fix float32 convert for flashinfer sink support (#23016) · 000cceca
  Michael Goin authored Aug 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  000cceca
12 Aug, 2025 1 commit
- [gpt-oss] Enable gpt-oss on ampere (#22714) · 007dd908
  Yongye Zhu authored Aug 12, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  007dd908