Commits · 14561fabfd39030168a3365327d921ae5c49bb0c · OpenDAS / vllm_cscc

24 Feb, 2026 1 commit
- [Perf] Optimize pooling model redundant copy, 1.8% throughput improvement (#35127) · 14561fab
  Wentao Ye authored Feb 24, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  14561fab
23 Feb, 2026 3 commits
- [Refactor] Decouple TimingContext from InputProcessingContext (#35083) · 39264545
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39264545
- [Model Runner V2] Remove propose_draft method (#35070) · c645e9a2
  Woosuk Kwon authored Feb 22, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  c645e9a2
- [Model Runner V2][Minor] Remove redundant `do_spec_decode` field (#35039) · 944ffb59
  Nick Hill authored Feb 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  944ffb59
22 Feb, 2026 3 commits

[Spec Decode] Defer clearing KV connector metadata for EAGLE3 speculative... · b9c2a565

qizixi authored Feb 22, 2026


[Spec Decode] Defer clearing KV connector metadata for EAGLE3 speculative decode + prefill / decode disagg setup (#34529)
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

b9c2a565

[Model Runner V2] Enable CUDA graph for Eagle3 (#35040) · 2cbf9656
Woosuk Kwon authored Feb 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
2cbf9656
[Model Runner V2] Support attention group (#35036) · b71fbd06
Woosuk Kwon authored Feb 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
b71fbd06

21 Feb, 2026 1 commit
- [Model Runner V2] Support Eagle3 (no CUDA graph) (#35029) · a4047d4e
  Woosuk Kwon authored Feb 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  a4047d4e
20 Feb, 2026 3 commits
- [CI] Revert PRs 34818 and 33600 (#34979) · aaefc58e
  Lucas Wilkinson authored Feb 20, 2026
  
  aaefc58e
- [BUGFIX] Fix `_dummy_run` missing `prepare_inputs_event` synchronization (#34866) · 59965aff
  Vadim Gimpelson authored Feb 20, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  59965aff
- [Model Runner V2] Minor CPU optimizations (#34856) · 40b2f1c3
  Nick Hill authored Feb 19, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  40b2f1c3
19 Feb, 2026 2 commits

[Bugfix] Fix Basic Models Test (#34818) · 662205d3

Matthew Bonanni authored Feb 19, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

662205d3

[Model Runner V2] Use FP32 for Gumbel Noise (#34854) · 5fcb0cdd
Woosuk Kwon authored Feb 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
5fcb0cdd

18 Feb, 2026 6 commits
- [Model Runner V2] Remove unnecessary copies in PW CUDA graph capture (#34849) · c878b43b
  Woosuk Kwon authored Feb 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  c878b43b
- [Model Runner V2] support piecewise & mixed cudagraph (#32771) · 11d3976b
  zhrrr authored Feb 19, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  11d3976b
- [Model Runner V2] Minor simplification for DCP (#34786) · 95be2a7f
  Woosuk Kwon authored Feb 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  95be2a7f
- [Model Runner V2] Avoid prepare prefill kernel launch overhead (#34780) · c50e105a
  Nick Hill authored Feb 18, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  c50e105a
- [Model Runner V2] A bit more PP simplification (#34766) · a49ea5a5
  Nick Hill authored Feb 17, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  a49ea5a5
- [Feature] Decode Context Parallel support for GPU model runner v2 (#34179) · ab33d2a6
  Wentao Ye authored Feb 17, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  ab33d2a6
17 Feb, 2026 8 commits
- [Model Runner V2] Further simplification for PP (#34724) · be3af2d2
  Woosuk Kwon authored Feb 17, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  be3af2d2
- Fix docs build warning (#34686) · 28bffe94
  Harry Mellor authored Feb 17, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  28bffe94
- [Model Runner V2] Minor refactoring for penalties (#34662) · d00df624
  Woosuk Kwon authored Feb 16, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  d00df624
- [Model Runner V2] Minor simplification for BadWordsState (#34669) · 9752da9d
  Woosuk Kwon authored Feb 16, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  9752da9d
- [Model Runner V2] Minor cleanup for PP (#34666) · 04925b22
  Woosuk Kwon authored Feb 16, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  04925b22
- [Model Runner V2] Fix unintended CPU-GPU sync in make_dummy (#34667) · d74278fb
  Woosuk Kwon authored Feb 16, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  d74278fb
- [Core] Pipeline Parallel support for Model Runner V2 (#33960) · 9a8853f7
  zhanqiuhu authored Feb 16, 2026
```
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
```
  9a8853f7
- [Model Runner V2] support bad_words sampling param (#33433) · 387a1898
  zhrrr authored Feb 17, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  387a1898
15 Feb, 2026 1 commit
- [Model Runner V2] Minor cleanup for Sampler (#34563) · 9ca768c7
  Woosuk Kwon authored Feb 14, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  9ca768c7
14 Feb, 2026 2 commits
- [Hybrid] Enable mamba prefix cache "align" mode with async scheduling (#33997) · d5fe3f70
  Thomas Parnell authored Feb 14, 2026
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  d5fe3f70
- [Feature][Perf] Support Selective CPU Weight Offloading (#34535) · b37b6797
  Wei Zhao authored Feb 13, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  b37b6797
13 Feb, 2026 3 commits
- [Feature] Pipeline Parallel Async send/recv, 2.9% E2E throughput improvement (#33368) · 3d2a026f
  Wentao Ye authored Feb 13, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  3d2a026f
- [BugFix] Fix and optimize max_num_blocks_per_req calculation for MambaSpec (#34440) · 7a8a46dd
  Harry Huang authored Feb 13, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
```
  7a8a46dd
- [Core] Profiler improvements and lazy initialization (#33198) · 4453ba8d
  Jaewon authored Feb 12, 2026
```
Signed-off-by: Jaewon Lee <jaewon@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  4453ba8d
11 Feb, 2026 3 commits
- [Model Runner V2] Init cuda graph pool when necessary (#33217) · ffb3d553
  Xinyu Chen authored Feb 12, 2026
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  ffb3d553
- [Bugfix][CPU] Fix llama4 inference on CPU (#34321) · 05339a7b
  Li, Jiang authored Feb 11, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  05339a7b
- [MoE Refactor] Introduce MoERunner abstraction and move execution logic from... · d1481ba7
  bnellnm authored Feb 10, 2026
```
[MoE Refactor] Introduce MoERunner abstraction and move execution logic from FusedMoE to DefaultMoERunner (#32344)
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  d1481ba7
10 Feb, 2026 4 commits
- [BugFix] Fix async EPLB hang with DeepEP LL all2all backend (#32860) · bb2fc8b5
  Ilya Markov authored Feb 10, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
  bb2fc8b5
- [Bugfix] Fix weights offloading for sleep mode (#32947) · 506ad7d7
  J Seppänen authored Feb 10, 2026
```
Signed-off-by: Jarno Seppänen <jseppanen@nvidia.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  506ad7d7
- [Misc] Introduce ec_both role EC (encoder cache) connector (#34182) · 33bcd3dc
  Qi Wang authored Feb 10, 2026
```
Signed-off-by: Qi Wang <qiwa@nvidia.com>
```
  33bcd3dc
- [Model Runner V2] Use pinned memory for write_contents (#34222) · a2443de5
  Woosuk Kwon authored Feb 10, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  a2443de5