Commits · 3055232ba0b95a68b3609cd95c029f94809e8bf1 · OpenDAS / vllm_cscc · GitLab

15 Jan, 2026 1 commit
- [Model Runner V2] Support FlashInfer backend & Fix CUDA Graph bug [1/2] (#32348) · 6218034d
  Woosuk Kwon authored Jan 15, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6218034d
14 Jan, 2026 1 commit
- [Model Runner V2] Refactor Sampler (#32245) · 90c08369
  Woosuk Kwon authored Jan 13, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  90c08369
12 Jan, 2026 2 commits
- [Model Runner V2] Add support for M-RoPE (#32143) · 0a7dd237
  Woosuk Kwon authored Jan 12, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0a7dd237
- [Model Runner V2] Remove async barrier (#32083) · 025a32f9
  Woosuk Kwon authored Jan 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  025a32f9
11 Jan, 2026 1 commit
- [Model Runner V2] Skip building deprecated fields in attn metadata (#32132) · 19504ac0
  Woosuk Kwon authored Jan 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  19504ac0
08 Jan, 2026 2 commits
- [Model Runner V2] Simplify BlockTables with UVA (#31965) · 75082432
  Woosuk Kwon authored Jan 08, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  75082432
- [Misc] Tidy up some spec decode logic in GPUModelRunner (#31591) · a3d909ad
  Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  a3d909ad
07 Jan, 2026 1 commit
- [refactor] refactor memory constants usage (#31865) · c907d221
  Ning Xie authored Jan 08, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c907d221
02 Jan, 2026 1 commit
- [BugFix] Support online dense model DP without overhead (#30739) · bd877162
  Nick Hill authored Jan 02, 2026
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  bd877162
31 Dec, 2025 1 commit
- [BugFix] Fix async scheduling for pooling models (#31584) · 6c2cfb62
  Nick Hill authored Dec 31, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  6c2cfb62
09 Dec, 2025 1 commit
- [Model Runner V2] Support num NaNs in logits (#30187) · d471b2af
  Woosuk Kwon authored Dec 09, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d471b2af
04 Dec, 2025 1 commit
- [Model Runner V2] Implement get_num_sampled_and_rejected kernel (#30029) · cc050558
  Woosuk Kwon authored Dec 04, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cc050558
30 Nov, 2025 1 commit
- [Core] Enable `inputs_embeds_size` separate from `hidden_size` (#29741) · 64bc09ba
  Cyrus Leung authored Nov 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64bc09ba
29 Nov, 2025 4 commits
- [Model Runner V2] Add sample/ directory and reorganize files (#29719) · 6afc0ffa
  Woosuk Kwon authored Nov 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6afc0ffa
- [Model Runner V2] Don't use UVA buffer for prefill_len (#29713) · 4a80ad0a
  Woosuk Kwon authored Nov 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4a80ad0a
- [Model Runner V2] Refactor prefill token preparation (#29712) · ca1b1e72
  Woosuk Kwon authored Nov 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ca1b1e72
- [Model Runner V2] Support penalties using bin counts (#29703) · 1dcafb3d
  Woosuk Kwon authored Nov 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  1dcafb3d
27 Nov, 2025 3 commits
- [Model Runner V2] Implement multi-step Eagle with CUDA graph (#29559) · da3222f3
  Woosuk Kwon authored Nov 27, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  da3222f3
- [Model Runner V2] Minor cleanup for build_attn_metadata (#29576) · ee80aee1
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ee80aee1
- [Model Runner V2] Minor code cleanup (#29570) · 0aeb698b
  Woosuk Kwon authored Nov 26, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0aeb698b
24 Nov, 2025 3 commits
- [Model Runner V2] Simplify Eagle bookkeeping with num_rejected (#29347) · f32c7d6f
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  f32c7d6f
- [Model Runner V2] Change Numba AoT to JIT (#29328) · cec418b5
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cec418b5
- [Model Runner V2] Implement Single-step Eagle 1 (#29300) · cc313cb7
  Woosuk Kwon authored Nov 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  cc313cb7
23 Nov, 2025 4 commits
- [Model Runner V2] Optimize CUDA graph capture time (#29275) · 62d54ba4
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  62d54ba4
- [Model Runner V2] Support spec decoding [1/N] (#29274) · b004c004
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b004c004
- [Model Runner V2] Change bookkeeping logic in preparation for spec decoding (#29194) · 7f12c82f
  Woosuk Kwon authored Nov 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f12c82f
- [Model Runner V2] Minor fix for cudagraph_utils (#29256) · 20ee418a
  Woosuk Kwon authored Nov 22, 2025
  
  20ee418a
21 Nov, 2025 2 commits
- [Chore] Fix pre-commit error after #25266 (#29190) · 1bed891f
  Woosuk Kwon authored Nov 21, 2025
  
  1bed891f
- GPU Model Runner V2 (#25266) · 30b44a15
  Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  30b44a15