Commits · cb5f7501cbc80a394afbce0c877593be8cf6175c · OpenDAS / vllm_cscc

24 Mar, 2026 1 commit
- [MRV2] Fix for DS v3.2 (#38030) · 4b53740d
  Woosuk Kwon authored Mar 24, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  4b53740d
20 Mar, 2026 2 commits
- [Model Runner V2] Support Streaming Inputs (#37028) · 85f671b8
  Santino Ramos authored Mar 20, 2026
```
Signed-off-by: Santino Ramos <elsantinoramos@gmail.com>
```
  85f671b8
- [Model Runner V2] fix draft attention metadata generation (#37364) · 39474513
  Giancarlo Delfin authored Mar 19, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  39474513
11 Mar, 2026 1 commit
- [Model Runner V2] Add WhisperModelState [6/N] (#35790) · 55eed6b7
  Woosuk Kwon authored Mar 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  55eed6b7
22 Feb, 2026 1 commit
- [Model Runner V2] Support attention group (#35036) · b71fbd06
  Woosuk Kwon authored Feb 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  b71fbd06
18 Feb, 2026 2 commits
- [Model Runner V2] Minor simplification for DCP (#34786) · 95be2a7f
  Woosuk Kwon authored Feb 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  95be2a7f
- [Feature] Decode Context Parallel support for GPU model runner v2 (#34179) · ab33d2a6
  Wentao Ye authored Feb 17, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ab33d2a6
09 Feb, 2026 1 commit
- [ModelRunner V2][BugFix] Fix `max_query_len` calculation (#34167) · e7e52781
  Nick Hill authored Feb 09, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  e7e52781
01 Feb, 2026 1 commit
- [ModelRunner V2] Misc minor simplifications and optimizations (#33467) · e535d90d
  Nick Hill authored Feb 01, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  e535d90d
24 Jan, 2026 1 commit

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

23 Jan, 2026 1 commit
- [Model Runner V2] Add KV Connector support (#32742) · 8518b304
  Nick Hill authored Jan 23, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  8518b304
20 Jan, 2026 1 commit
- [Model Runner V2] Support FLASHINFER_MLA backend (#32709) · 9ab4388c
  Woosuk Kwon authored Jan 20, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9ab4388c
12 Jan, 2026 1 commit
- [3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) · 20228cb8
  Matthew Bonanni authored Jan 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  20228cb8
11 Jan, 2026 1 commit
- [Model Runner V2] Skip building deprecated fields in attn metadata (#32132) · 19504ac0
  Woosuk Kwon authored Jan 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  19504ac0
09 Jan, 2026 1 commit
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
10 Dec, 2025 1 commit

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable... · abe93bce

Lucas Wilkinson authored Dec 09, 2025


[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

abe93bce

27 Nov, 2025 1 commit
- [Model Runner V2] Minor cleanup for build_attn_metadata (#29576) · ee80aee1
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ee80aee1
23 Nov, 2025 1 commit
- [Model Runner V2] Change bookkeeping logic in preparation for spec decoding (#29194) · 7f12c82f
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f12c82f
21 Nov, 2025 2 commits
- [Chore] Fix pre-commit error after #25266 (#29190) · 1bed891f
  Woosuk Kwon authored Nov 21, 2025
  
  1bed891f
- GPU Model Runner V2 (#25266) · 30b44a15
  Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  30b44a15