Commits · b30dfa03c564ce51c56bf2dd16283f074253c27c · OpenDAS / vllm_cscc

11 Nov, 2025 1 commit

[Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03

Matthew Bonanni authored Nov 11, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

b30dfa03

03 Nov, 2025 1 commit
- Add TP parameter to attention tests (#27683) · 01baefe6
  Matthew Bonanni authored Nov 03, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  01baefe6
31 Oct, 2025 1 commit
- Add FLASHINFER_MLA to test_mla_backends and add B200 CI run (#27663) · f29aeb5a
  Matthew Bonanni authored Oct 31, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f29aeb5a
30 Oct, 2025 1 commit
- [BugFix] Reordering extend logic fix (#27739) · b5d70751
  Lucas Wilkinson authored Oct 30, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  b5d70751
28 Oct, 2025 2 commits

[Misc] Make reorder batch also separate extends (#27367) · 141e6a05
Lucas Wilkinson authored Oct 29, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
141e6a05

[Bugfix][CI] Fix v1 attention backend tests and add CI coverage (#26597) · a8c02fb5

Mohammad Miadh Angkad authored Oct 28, 2025


Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
Signed-off-by: Mohammad Miadh Angkad <mangkad.bsdsba2027@aim.edu>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

a8c02fb5

26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

18 Oct, 2025 2 commits

[Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
6ac5e06f

[CI/Build] tests(v1): feed Triton attention the (num_blocks, 2, …) KV cache... · c3123207

Huamin Li authored Oct 17, 2025


[CI/Build] tests(v1): feed Triton attention the (num_blocks, 2, …) KV cache layout in backend-correctness tests (#26663)
Signed-off-by: Huamin Li <3ericli@gmail.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

c3123207

17 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
14 Oct, 2025 1 commit
- [Attention][Spec Decode] FlashMLA spec decode support (#26541) · 82af928c
  Matthew Bonanni authored Oct 14, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  82af928c
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
08 Oct, 2025 3 commits
- [Attention] Implement universal BACKEND_MAP (#25900) · 76879cc1
  Matthew Bonanni authored Oct 08, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  76879cc1
- Tidy `vllm/config/__init__.py` to only add classes and functions (#26405) · 2f99f2f5
  Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2f99f2f5
- [Misc] Clean up cruft from previous FlashMLA sparse implementation (#26125) · f80e7866
  Lucas Wilkinson authored Oct 07, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  f80e7866
07 Oct, 2025 2 commits
- [V0 Deprecation] Remove `VLLM_USE_V1` from tests (#26341) · 1e4ecca1
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1e4ecca1
- [Core] Simplify the Dp padding/should ubatch coordination logic (#25768) · 2111b464
  Sage Moore authored Oct 06, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  2111b464
06 Oct, 2025 1 commit
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
03 Oct, 2025 1 commit
- [Attention] Move Backend enum into registry (#25893) · 2aaa4238
  Matthew Bonanni authored Oct 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2aaa4238
02 Oct, 2025 1 commit
- [Deepseek v3.2] Support indexer prefill chunking (#25999) · 1e50f1be
  Chen Zhang authored Oct 02, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  1e50f1be
30 Sep, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

26 Sep, 2025 1 commit

[V1] address post issues related to #20059 (part 1) (#23046) · f075693d

fhl2000 authored Sep 27, 2025


Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f075693d

25 Sep, 2025 1 commit
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
24 Sep, 2025 2 commits

[Bug] fix import and unit test (#25558) · 58c360d9
Jonas M. Kübler authored Sep 24, 2025
```
Signed-off-by: Jonas M. Kübler <44084297+jmkuebler@users.noreply.github.com>
```
58c360d9

[Spec Decode] Enable FlashInfer Spec Decoding (#25196) · c30b405b

Benjamin Chislett authored Sep 23, 2025


Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: lhsjohn <huashuoli@tencent.com>

c30b405b

23 Sep, 2025 1 commit

[Core/DBO][2/N] Dual-Batch Overlap add DeepEP High Throughput support and Prefill support (#24845) · cc1dc7ed

Lucas Wilkinson authored Sep 23, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

cc1dc7ed

21 Sep, 2025 1 commit
- [V1] Add sliding window support to Flex Attention backend (#24089) · cf56cf78
  Isotr0py authored Sep 21, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cf56cf78
16 Sep, 2025 1 commit

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) · 56793995

Sage Moore authored Sep 16, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

56793995

12 Sep, 2025 2 commits
- Add FLASHINFER_MLA to backend selector test (#24753) · 5fe643fc
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  5fe643fc
- [Attention][FlashInfer] Enable FP8 FlashInfer (TRTLLM) MLA decode (#24705) · 7ba32aa6
  Matthew Bonanni authored Sep 12, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  7ba32aa6
08 Sep, 2025 1 commit

[Attention] FlashAttention MLA cudagraph support (#23958) · 620db1fc

Matthew Bonanni authored Sep 08, 2025


Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

620db1fc

04 Sep, 2025 1 commit

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

03 Sep, 2025 1 commit
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
25 Aug, 2025 2 commits
- Updates to Flex + VLLm integration (#21416) · e0329ed4
  Driss Guessous authored Aug 25, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  e0329ed4
- [Attention] Unify mamba and attention backend selection (#23171) · 5c4b6e66
  Ayush Satyam authored Aug 25, 2025
```
Signed-off-by: Ayush Satyam <ayushsatyam146@gmail.com>
```
  5c4b6e66
20 Aug, 2025 2 commits
- Feature/mla tests (#23195) · 10cc12ba
  Matthew Bonanni authored Aug 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  10cc12ba
- [Misc] Add max_seq_len to CommonAttentionMetadata (#23216) · d6d13bd4
  Woosuk Kwon authored Aug 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d6d13bd4
15 Aug, 2025 1 commit
- [Mamba] - refactor: Renamed mamba_attn to mamba2_attn (#22818) · 3d232dbd
  Asaf Joseph Gardin authored Aug 15, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  3d232dbd
08 Aug, 2025 1 commit
- [ROCm] [V1] [SpecDec] Enable Speculative Decoding on ROCm V1 Engine (#21496) · 1ee5ead5
  TJian authored Aug 07, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  1ee5ead5