Commits · 03da3b52ef6f3f3d9af5c1942c93a9ace7c2a6bf · OpenDAS / vllm_cscc

16 Jan, 2026 1 commit
- [Bugfix] Refactor to support DP parallel in R3 (#32306) · 03da3b52
  Hongxin Xu authored Jan 16, 2026
```
Signed-off-by: xhx1022 <1737006628@qq.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>
```
  03da3b52
15 Jan, 2026 2 commits
- [Model Runner V2] Support FlashInfer backend & Fix CUDA Graph bug [1/2] (#32348) · 6218034d
  Woosuk Kwon authored Jan 15, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6218034d
- [2/N] Move cache factories to MM registry (#32382) · cbbae38f
  Cyrus Leung authored Jan 15, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbbae38f
14 Jan, 2026 4 commits
- [Misc] Make mem utils can be reused by other platforms (#32322) · ce094624
  Shanshan Shen authored Jan 14, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  ce094624
- [Refactor] Move top-level dummy data generation to registry (#32310) · 90db5b31
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  90db5b31
- [misc] Remove is_torch_equal_or_newer(2.4) cases (#32296) · 79336380
  Angela Yi authored Jan 13, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  79336380
- [Model Runner V2] Refactor Sampler (#32245) · 90c08369
  Woosuk Kwon authored Jan 13, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  90c08369
13 Jan, 2026 1 commit
- [6/N][Attention] Move utils to more appropriate locations (#32215) · 98f60e5a
  Matthew Bonanni authored Jan 13, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  98f60e5a
12 Jan, 2026 6 commits
- [Model Runner V2] Add support for M-RoPE (#32143) · 0a7dd237
  Woosuk Kwon authored Jan 12, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  0a7dd237
- [Model Runner V2] Minor refactor for logit_bias (#32209) · dec28688
  Woosuk Kwon authored Jan 12, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  dec28688
- [Model Runner V2] Support logit_bias, allowed_token_ids, min_tokens (#32163) · ca81811b
  Woosuk Kwon authored Jan 12, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  ca81811b
- [3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) · 20228cb8
  Matthew Bonanni authored Jan 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  20228cb8
- [Feature] Support recording expert indices for rollout router replay (#28284) · 49e6b86c
  Hongxin Xu authored Jan 12, 2026
```
Signed-off-by: xhx1022 <1737006628@qq.com>
Signed-off-by: Hongxin Xu <70438206+xhx1022@users.noreply.github.com>
Signed-off-by: arlenxu <arlenxu@tencent.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>
```
  49e6b86c
- [Model Runner V2] Remove async barrier (#32083) · 025a32f9
  Woosuk Kwon authored Jan 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  025a32f9
11 Jan, 2026 2 commits
- [Model Runner V2] Skip building deprecated fields in attn metadata (#32132) · 19504ac0
  Woosuk Kwon authored Jan 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  19504ac0
- [KVConnector] OffloadingConnector: Fix bug in handling of preemptions (#29870) · 4c16ba61
  Or Ozeri authored Jan 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  4c16ba61
09 Jan, 2026 6 commits
- [perf][async] support non cpu sync get logprob tensors for spec (#31336) · 97ba96fb
  zhrrr authored Jan 10, 2026
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  97ba96fb
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
- [UX] Add vLLM model inspection view (#29450) · d5ec6c05
  Michael Goin authored Jan 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d5ec6c05
- [Cleanup] Remove obsolete spec decoding compatibility logic (#32003) · 29ce4822
  Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  29ce4822
- [Async][Feat] support apply penalty or bad_words for async + spec (#30495) · 8ff4a995
  zhrrr authored Jan 09, 2026
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  8ff4a995
- [Feature] Add iteration level logging and enhance nvtx marker (#31193) · 6ebe34d6
  Max Hu authored Jan 08, 2026
```
Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
```
  6ebe34d6
08 Jan, 2026 4 commits

[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues... · 6cdf015c

Lucas Wilkinson authored Jan 08, 2026


[Misc] Fix `Current vLLM config is not set.` warnings, assert to avoid issues in the future (#31747)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

6cdf015c

[Model Runner V2] Simplify BlockTables with UVA (#31965) · 75082432
Woosuk Kwon authored Jan 08, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
75082432
[Misc] Tidy up some spec decode logic in GPUModelRunner (#31591) · a3d909ad
Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
a3d909ad
[BugFix] Fix spec decoding edge case bugs (#31944) · 287b37cd
Nick Hill authored Jan 07, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
287b37cd

07 Jan, 2026 6 commits
- [refactor] refactor memory constants usage (#31865) · c907d221
  Ning Xie authored Jan 08, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  c907d221
- [Refactor] Clean up pooler modules (#31897) · b7036c87
  Cyrus Leung authored Jan 08, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7036c87
- [Chore] Migrate V0 attention utils (#31891) · b665bbc2
  Cyrus Leung authored Jan 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b665bbc2
- [Refactor][TPU] Remove torch_xla path and use tpu-inference (#30808) · e7596371
  weiyu authored Jan 07, 2026
```
Signed-off-by: Wei-Yu Lin <weiyulin@google.com>
Signed-off-by: weiyu <62784299+weiyu0824@users.noreply.github.com>
```
  e7596371
- [Bugfix] Fix race condition in async-scheduling for vlm model (#31841) · efeaac92
  tianshu-Michael-yu authored Jan 06, 2026
```
Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
```
  efeaac92
- [Chore] Try remove `init_cached_hf_modules` (#31786) · aafd4d23
  Cyrus Leung authored Jan 07, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aafd4d23
06 Jan, 2026 2 commits
- [Perf] Async Scheduling + Speculative Decoding + Structured Outputs (#29821) · f7008ce1
  Benjamin Chislett authored Jan 06, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  f7008ce1
- [Log] add log about gpu worker init snapshot and requested memory (#29493) · 6f5e6533
  Ning Xie authored Jan 07, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  6f5e6533
05 Jan, 2026 4 commits
- [Bug] Revert torch warning fix (#31585) · af9a7ec2
  Wentao Ye authored Jan 05, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  af9a7ec2
- [Misc] Various code simplifications (#31666) · 43e3f8e4
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  43e3f8e4
- [Platform] Deprecate seed_everything (#31659) · bb4337b3
  wangxiyuan authored Jan 05, 2026
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  bb4337b3
- [Minor] Small pooler output processing optimization (#31667) · da436f86
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  da436f86
02 Jan, 2026 1 commit
- [BugFix] Support online dense model DP without overhead (#30739) · bd877162
  Nick Hill authored Jan 02, 2026
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: njhill <nickhill123@gmail.com>
```
  bd877162
31 Dec, 2025 1 commit
- [BugFix] Fix async scheduling for pooling models (#31584) · 6c2cfb62
  Nick Hill authored Dec 31, 2025
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  6c2cfb62