Commits · 2bcf71b9c0305e2a3d645e7a5ced4460262b4a6c · OpenDAS / vllm_cscc

22 Feb, 2026 2 commits
- [Model Runner V2] Enable CUDA graph for Eagle3 (#35040) · 2cbf9656
  Woosuk Kwon authored Feb 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  2cbf9656
- [Model Runner V2] Support attention group (#35036) · b71fbd06
  Woosuk Kwon authored Feb 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  b71fbd06
21 Feb, 2026 1 commit
- [Model Runner V2] Support Eagle3 (no CUDA graph) (#35029) · a4047d4e
  Woosuk Kwon authored Feb 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  a4047d4e
20 Feb, 2026 1 commit
- [Model Runner V2] Minor CPU optimizations (#34856) · 40b2f1c3
  Nick Hill authored Feb 19, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  40b2f1c3
18 Feb, 2026 5 commits
- [Model Runner V2] support piecewise & mixed cudagraph (#32771) · 11d3976b
  zhrrr authored Feb 19, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  11d3976b
- [Model Runner V2] Minor simplification for DCP (#34786) · 95be2a7f
  Woosuk Kwon authored Feb 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  95be2a7f
- [Model Runner V2] Avoid prepare prefill kernel launch overhead (#34780) · c50e105a
  Nick Hill authored Feb 18, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  c50e105a
- [Model Runner V2] A bit more PP simplification (#34766) · a49ea5a5
  Nick Hill authored Feb 17, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  a49ea5a5
- [Feature] Decode Context Parallel support for GPU model runner v2 (#34179) · ab33d2a6
  Wentao Ye authored Feb 17, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ab33d2a6
17 Feb, 2026 5 commits
- [Model Runner V2] Further simplification for PP (#34724) · be3af2d2
  Woosuk Kwon authored Feb 17, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  be3af2d2
- [Model Runner V2] Minor refactoring for penalties (#34662) · d00df624
  Woosuk Kwon authored Feb 16, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  d00df624
- [Model Runner V2] Minor cleanup for PP (#34666) · 04925b22
  Woosuk Kwon authored Feb 16, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  04925b22
- [Core] Pipeline Parallel support for Model Runner V2 (#33960) · 9a8853f7
  zhanqiuhu authored Feb 16, 2026
```
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
```
  9a8853f7
- [Model Runner V2] support bad_words sampling param (#33433) · 387a1898
  zhrrr authored Feb 17, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  387a1898
09 Feb, 2026 1 commit
- [ModelRunner V2][BugFix] Fix `max_query_len` calculation (#34167) · e7e52781
  Nick Hill authored Feb 09, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  e7e52781
06 Feb, 2026 1 commit
- [Model Runner V2] support apply penalty for spec decode (#33251) · 16786da7
  zhrrr authored Feb 07, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  16786da7
02 Feb, 2026 1 commit
- [ModelRunner V2] Support spec decode with structured outputs (#33374) · cf0a99f8
  Nick Hill authored Feb 01, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  cf0a99f8
01 Feb, 2026 2 commits
- [ModelRunner V2] Misc minor simplifications and optimizations (#33467) · e535d90d
  Nick Hill authored Feb 01, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  e535d90d
- [Bugfix] Fix inconsistent handling of cache reset (#33481) · 79b6ec6a
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  79b6ec6a
31 Jan, 2026 1 commit
- [ModelRunner V2] Fix spec decoding + logprobs (#33391) · 876a16f4
  Nick Hill authored Jan 30, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  876a16f4
28 Jan, 2026 2 commits
- [ModelRunner V2] Misc code simplification and cleanup (#33266) · 6bf3b46d
  Nick Hill authored Jan 28, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  6bf3b46d
- [Model Runner V2] Use a different stream for grammar bitmask h2d copy (#33059) · 46ec6d71
  Woosuk Kwon authored Jan 27, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  46ec6d71
27 Jan, 2026 1 commit

[Model Runner V2] Remove UvaBufferPool for cpu->gpu copy (#33055) · 6d86fde0

Woosuk Kwon authored Jan 26, 2026


Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Nick Hill <nhill@redhat.com>

6d86fde0

26 Jan, 2026 3 commits
- [Model Runner V2] Add LoRAState to consolidate lora logic (#33062) · a9b53dd4
  Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  a9b53dd4
- [Model Runner V2] Minor simplification for finish_requests (#33048) · 2f0d3ba7
  Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  2f0d3ba7
- [Model Runner V2] Fix slot_mapping after #25954 (#33046) · edf927bc
  Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  edf927bc
24 Jan, 2026 1 commit

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

23 Jan, 2026 1 commit
- [Model Runner V2] Add KV Connector support (#32742) · 8518b304
  Nick Hill authored Jan 23, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  8518b304
22 Jan, 2026 1 commit
- [Model Runner V2] Do not error on attention backends (#32820) · 5e00b561
  Woosuk Kwon authored Jan 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  5e00b561
21 Jan, 2026 2 commits
- [Model Runner V2] Refactor Prompt Logprobs (#32811) · 408195ec
  Woosuk Kwon authored Jan 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  408195ec
- [Model Runner V2] Minor refactor for `compute_slot_mappings` (#32794) · e1da249c
  Woosuk Kwon authored Jan 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e1da249c
20 Jan, 2026 3 commits
- [Model Runner V2] Support FLASHINFER_MLA backend (#32709) · 9ab4388c
  Woosuk Kwon authored Jan 20, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9ab4388c
- [Model Runner V2] Refactor get_cudagraph_and_dp_padding (#32625) · 7b7cdce9
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7b7cdce9
- [Model Runner V2] Initialized communication buffer for DP (#32624) · 05dc4bfa
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  05dc4bfa
19 Jan, 2026 3 commits
- [Model Runner V2] Refactor `dummy_run` (#32533) · 43fada53
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  43fada53
- [Model Runner V2] Refactor `update_states` (#32562) · 9a1f16da
  Woosuk Kwon authored Jan 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9a1f16da
- [Model Runner V2] Support VLM (#32546) · bb1848cd
  Woosuk Kwon authored Jan 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bb1848cd
18 Jan, 2026 2 commits
- [Model Runner V2] Minor optimization for eagle input processing (#32535) · 963dc0b8
  Woosuk Kwon authored Jan 17, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  963dc0b8
- [Model Runner V2] Move mrope_positions buffer to MRopeState (#32532) · 4147910f
  Woosuk Kwon authored Jan 17, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4147910f
15 Jan, 2026 1 commit
- [Model Runner V2] Support FlashInfer backend & Fix CUDA Graph bug [1/2] (#32348) · 6218034d
  Woosuk Kwon authored Jan 15, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6218034d