Commits · 13d8746c545576bcb6e0771ee4dc0b6fae694fa1 · OpenDAS / vllm_cscc

23 Jan, 2026 1 commit
- [Feature]: Remove DtoH Copy for lfm2_vl On Default Stream (#32815) · 13d8746c
  tianshu-Michael-yu authored Jan 23, 2026
```
Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
```
  13d8746c
19 Jan, 2026 1 commit
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
13 Jan, 2026 1 commit
- [6/N][Attention] Move utils to more appropriate locations (#32215) · 98f60e5a
  Matthew Bonanni authored Jan 13, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  98f60e5a
12 Jan, 2026 2 commits
- [3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) · 20228cb8
  Matthew Bonanni authored Jan 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  20228cb8
- [Bugfix] Fix stale SSM state for new Mamba requests scheduled as decode (#32118) · 8fb2c135
  Asaf Joseph Gardin authored Jan 12, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  8fb2c135
10 Jan, 2026 1 commit
- [Misc] Delay deprecation of CommonAttentionMetadata properties (#32074) · da6709c9
  Lucas Wilkinson authored Jan 10, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  da6709c9
09 Jan, 2026 1 commit
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
07 Jan, 2026 1 commit

fixed mypy warnings for files vllm/v1/attention with TEMPORARY workaround (#31465) · 0a2c2dc3

Jack Yang authored Jan 06, 2026


Signed-off-by: Zhuohao Yang <zy242@cornell.edu>
Co-authored-by: Zhuohao Yang <zy242@cornell.edu>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

0a2c2dc3

06 Jan, 2026 1 commit

[Attention][1/n] Remove usage of deprecated `seq_lens_cpu` and... · e0327c9d

Lucas Wilkinson authored Jan 06, 2026


[Attention][1/n] Remove usage of deprecated `seq_lens_cpu` and `num_computed_tokens_cpu` CommonAttentionMetadata properties (#31773)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

e0327c9d

23 Dec, 2025 1 commit
- adapt voxtral (#31095) · 3faa8bee
  Patrick von Platen authored Dec 23, 2025
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  3faa8bee
16 Dec, 2025 2 commits

[Attention] Cache attention metadata builds across hybrid KV-cache groups (#29627) · 9fec0e13
Lucas Wilkinson authored Dec 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
9fec0e13

[feature] extend DBO to XBO (#30120) · b9ff4f2a

jiangkuaixue123 authored Dec 16, 2025


Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: root <root@hk01dgx028.cm.cluster>

b9ff4f2a

12 Dec, 2025 1 commit
- [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
  Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3e41992f
10 Dec, 2025 1 commit

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable... · abe93bce

Lucas Wilkinson authored Dec 09, 2025


[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

abe93bce

09 Dec, 2025 1 commit

[Attention] Make `split_decodes_and_prefills(..., require_uniform=True)` support padding (#29644) · aed84691

Lucas Wilkinson authored Dec 09, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

aed84691

29 Nov, 2025 1 commit
- [BugFix] Fix DBO failing with TypeError: 'NoneType' object is not iterable (#29698) · e23f665d
  Lucas Wilkinson authored Nov 28, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e23f665d
27 Nov, 2025 3 commits
- [BugFix] Fix new nightly failures (#29578) · be493e0b
  Lucas Wilkinson authored Nov 27, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  be493e0b
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
- [Attention][Async] Eliminate `seq_lens_cpu` in FlashAttention metadata... · 77740191
  Matthew Bonanni authored Nov 26, 2025
```
[Attention][Async] Eliminate `seq_lens_cpu` in FlashAttention metadata building with DCP > 1 (#29449)
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77740191
26 Nov, 2025 1 commit
- [Core] Refactor padding logic and pad for CUDA graphs before attention metadata building (#28579) · 56539cdd
  Lucas Wilkinson authored Nov 26, 2025
  
  56539cdd
25 Nov, 2025 1 commit

[Core] Generalize Encoder-Decoder `seq_lens` computation to avoid Whisper... · 798e87db

Nicolò Lucchesi authored Nov 25, 2025


[Core] Generalize Encoder-Decoder `seq_lens` computation to avoid Whisper hardcoded logic   (#29268)
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>

798e87db

19 Nov, 2025 2 commits

[Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4

Qiu authored Nov 20, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>

2fd893b4

[BugFix] Fix async-scheduling + FlashAttn MLA (#28990) · 48fc8b1e
Lucas Wilkinson authored Nov 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
48fc8b1e

14 Nov, 2025 1 commit
- Fix KV sharing fast prefill with cudagraph enabled (#28537) · 9324e102
  Yong Hoon Shin authored Nov 14, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  9324e102
12 Nov, 2025 2 commits
- [Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding... · 30441957
  Benjamin Chislett authored Nov 12, 2025
```
[Perf] Refactor cudagraph_support to enable full CUDA graphs for spec decoding with FlashInfer (#28479)
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  30441957
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
08 Nov, 2025 1 commit

[DCP] Support dcp kv_cache interleave size > 1 (#26696) · 2108a571

zhangsicheng5 authored Nov 09, 2025


Signed-off-by: zhangsicheng5 <zhangsicheng5@huawei.com>
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: Qiu <qiuchunshuo@huawei.com>
Co-authored-by: QiuChunshuo <qiuchunshuo@huawei.com>

2108a571

05 Nov, 2025 1 commit
- [BugFix] Fix DCP Assert (AssertionError: DCP not support reorder_batch_threshold > 1 now.) (#28100) · d43ad5a7
  Lucas Wilkinson authored Nov 05, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  d43ad5a7
04 Nov, 2025 1 commit
- [ROCm][Perf] New design on ROCm AITER MHA backend Implementation (#25763) · dc937175
  Pleaplusone authored Nov 05, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  dc937175
30 Oct, 2025 1 commit
- [BugFix] Reordering extend logic fix (#27739) · b5d70751
  Lucas Wilkinson authored Oct 30, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  b5d70751
28 Oct, 2025 1 commit
- [Misc] Make reorder batch also separate extends (#27367) · 141e6a05
  Lucas Wilkinson authored Oct 29, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  141e6a05
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

14 Oct, 2025 1 commit

[DCP] Support Decode Context Parallel (DCP) for GQA with FlashAttention (#24864) · ea97940d

Jaya Yuan authored Oct 14, 2025


Signed-off-by: yuanyongjie.yyj <yuanyongjie.yyj@antgroup.com>
Signed-off-by: FENP <32334296+FENP@users.noreply.github.com>
Signed-off-by: Jaya Yuan <yuanyongjie.yyj@antgroup.com>

ea97940d

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 2 commits

[Attention][DCP] Support DCP with query length > 1 (MTP) with FA3 (#25049) · 3b736e1c
Ming Yang authored Oct 09, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
3b736e1c

Separate MLAAttention class from Attention (#25103) · e614ab78

Naveenraj Kamalakannan authored Oct 08, 2025

Signed-off-by: Naveenraj Kamalakannan <therealnaveenkamal@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

e614ab78

08 Oct, 2025 1 commit

[Bugfix][Flashinfer] fix VLLM_USE_TRTLLM_ATTENTION issue for models with diff... · b82f4307

elvischenv authored Oct 09, 2025


[Bugfix][Flashinfer] fix VLLM_USE_TRTLLM_ATTENTION issue for models with diff hyperparameters (#25924)
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>

b82f4307

07 Oct, 2025 1 commit
- [Spec Decode] Enable efficient speculative decoding with FlashInfer-MLA (#25984) · 3d1f6761
  Benjamin Chislett authored Oct 07, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  3d1f6761
06 Oct, 2025 1 commit
- [Attention] Remove unused reorder_batch method (#24463) · 4727a8af
  Matthew Bonanni authored Oct 06, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  4727a8af
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb