Commits · a474da28131f61684849b31e29af0eebaaedc383 · OpenDAS / vllm_cscc

24 Apr, 2026 4 commits
- [Refactor] Remove unused dead code (#40640) · a474da28
  Wentao Ye authored Apr 24, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a474da28
- [MRV2] Ensure warmup covers prefill path (#40746) · e9f331d7
  Nick Hill authored Apr 23, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  e9f331d7
- [Feat] Unified Synthetic Acceptance Rate for V1 and V2 (#40662) · 626daa20
  Benjamin Chislett authored Apr 23, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  626daa20
- [Core] Avoid seq_lens_cpu GPU->CPU sync (#40654) · fe85a92e
  Nick Hill authored Apr 23, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  fe85a92e
22 Apr, 2026 1 commit

[Refactor] Clean up log once `scope="local"` (#40540) · 8f87eb46

Wentao Ye authored Apr 22, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8f87eb46

21 Apr, 2026 2 commits

[MRv2]fix: model accuracy regression caused by reusing the stale... · 9a6a66f3

Zijing Liu authored Apr 21, 2026


[MRv2]fix: model accuracy regression caused by reusing the stale last_sampled_tokens and draft_tokens (#39833)
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>

9a6a66f3

[Model Runner V2] Multiple prompt logprobs support (#39937) · 66cc3fa5

Wentao Ye authored Apr 21, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

66cc3fa5

16 Apr, 2026 2 commits
- Gate SSU dispatch setup (#40039) · b897f00c
  roikoren755 authored Apr 16, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  b897f00c
- [Model Runner V2][BugFix] fix num_sampled dtype for probabilistic rej… (#39951) · 343f6523
  Giancarlo Delfin authored Apr 15, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  343f6523
15 Apr, 2026 1 commit
- [Model Runner V2] Disable piecewise cudagraph mode fallback for eagle draft decodes (#39773) · 3bfe55a0
  Giancarlo Delfin authored Apr 14, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  3bfe55a0
14 Apr, 2026 1 commit
- [Mamba] Flashinfer selective_state_update (#36162) · ecf5ff7c
  roikoren755 authored Apr 14, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  ecf5ff7c
13 Apr, 2026 1 commit
- [Model Runner V2] Add full cuda graph support for eagle prefill (#37588) · ccf90ba7
  Giancarlo Delfin authored Apr 13, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  ccf90ba7
10 Apr, 2026 1 commit
- [Model Runner V2] support auto resolve cudagraph mode/sizes based on attn backend (#32936) · 8f121f78
  zhrrr authored Apr 10, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  8f121f78
08 Apr, 2026 1 commit
- [Model Runner V2] Fuse probabilistic rejection sample kernels (#38496) · 5daf6227
  Giancarlo Delfin authored Apr 07, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  5daf6227
07 Apr, 2026 1 commit
- [BugFix][MRV2] Fix cuda event reuse race (#39115) · 62095e82
  Nick Hill authored Apr 06, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  62095e82
06 Apr, 2026 1 commit
- [MRV2] Fix hanging issue with DeepSeek V3.2 by setting `skip_attn=False` (#39098) · f186cfe7
  Woosuk Kwon authored Apr 06, 2026
```
Signed-off-by: WoosukKwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  f186cfe7
03 Apr, 2026 1 commit
- [MRV2][KVConnector] Fix missing build_connector_worker_meta (#38698) · 311c9816
  Yifan Qiao authored Apr 02, 2026
```
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
```
  311c9816
02 Apr, 2026 1 commit
- [Frontend] Re-enable running MaxSim on GPU (#38620) · a9b4f07b
  wang.yuqi authored Apr 03, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a9b4f07b
01 Apr, 2026 1 commit
- [Core] Simplify multimodal masking (#34246) · 4f6eed3b
  Lukas Geiger authored Apr 01, 2026
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  4f6eed3b
31 Mar, 2026 1 commit
- [Refactor] Remove dead code in kv connector and model runner (#38383) · 856589ed
  Wentao Ye authored Mar 31, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  856589ed
27 Mar, 2026 1 commit
- [Model Runner V2] Rebuild attention metadata before eagle decode full… (#38311) · 384e4d5f
  Giancarlo Delfin authored Mar 27, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  384e4d5f
26 Mar, 2026 2 commits
- [Model Runner V2] Enable forcing a specific acceptance rate during rejection sampling (#38045) · c32e9760
  Giancarlo Delfin authored Mar 26, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c32e9760
- Relocate Encoder CUDA graph manager (#38116) · 144030c8
  Woosuk Kwon authored Mar 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  144030c8
25 Mar, 2026 1 commit

[Feature] EPLB Support for GPU Model Runner v2 (#37488) · d7e93e13

Wentao Ye authored Mar 25, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>

d7e93e13

24 Mar, 2026 3 commits
- [MRV2] Fix for DS v3.2 (#38030) · 4b53740d
  Woosuk Kwon authored Mar 24, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  4b53740d
- [Model Runner V2][Minor] Simplify PP logic (#38031) · 4e824d1c
  Nick Hill authored Mar 24, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  4e824d1c
- [Model Runner V2] Gather multimodal embeddings before draft model postprocess (#37932) · 8f4824b6
  Giancarlo Delfin authored Mar 23, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  8f4824b6
23 Mar, 2026 2 commits

[MRV2] Consider spec decoding in warmup (#37812) · ffb5b32b

Woosuk Kwon authored Mar 23, 2026


Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

ffb5b32b

[Feature] ViT Full CUDA Graph (#35963) · f85e479e
Baorun (Lauren) Mu authored Mar 23, 2026
```
Signed-off-by: Baorun Mu <bmu@nvidia.com>
```
f85e479e

22 Mar, 2026 4 commits
- [Model Runner V2] Enable piecewise CUDA graphs for pipeline parallelism (#35162) · 63f49b8b
  zhanqiuhu authored Mar 22, 2026
```
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  63f49b8b
- [MRV2] Use FP64 for Gumbel noise (#37798) · a5e9d511
  Woosuk Kwon authored Mar 22, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  a5e9d511
- [MRV2] Skip hidden states allocation for PW CUDA graphs (#37818) · ce9b1d76
  Woosuk Kwon authored Mar 22, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  ce9b1d76
- [Model Runner V2] Support multi-modal embeddings for spec decode model (#36097) · b3e84601
  Giancarlo Delfin authored Mar 22, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  b3e84601
20 Mar, 2026 4 commits
- [Model Runner V2] Support Streaming Inputs (#37028) · 85f671b8
  Santino Ramos authored Mar 20, 2026
```
Signed-off-by: Santino Ramos <elsantinoramos@gmail.com>
```
  85f671b8
- [MRV2] Avoid recompilation of _gather_block_tables_kernel (#37645) · e80cfe57
  Woosuk Kwon authored Mar 20, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  e80cfe57
- [Model Runner V2] Fix draft logits not populated during cudagraph replay (#37639) · dcee9be9
  Giancarlo Delfin authored Mar 20, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  dcee9be9
- [Model Runner V2] fix draft attention metadata generation (#37364) · 39474513
  Giancarlo Delfin authored Mar 19, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  39474513
19 Mar, 2026 2 commits
- [MRV2] Use fp32 for draft logits (#37526) · 40b8363b
  Woosuk Kwon authored Mar 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  40b8363b
- [Model Runner V2] Spec decode rejection sampler logprobs support (#37237) · 053f3b63
  Giancarlo Delfin authored Mar 18, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  053f3b63
18 Mar, 2026 1 commit
- [Model Runner V2] Spec decode rejection sampler greedy support (#37238) · 04244fd0
  Giancarlo Delfin authored Mar 18, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  04244fd0