Commits · d76fc11ef5d40f86019811873ae340c8dcb64e3a · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "a9c821289582747c57f149017678a282f5e788e4"

27 Jan, 2026 1 commit

[Model Runner V2] Remove UvaBufferPool for cpu->gpu copy (#33055) · 6d86fde0

Woosuk Kwon authored Jan 26, 2026


Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Nick Hill <nhill@redhat.com>

6d86fde0

26 Jan, 2026 3 commits
- [Model Runner V2] Add LoRAState to consolidate lora logic (#33062) · a9b53dd4
  Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  a9b53dd4
- [Model Runner V2] Minor simplification for finish_requests (#33048) · 2f0d3ba7
  Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  2f0d3ba7
- [Model Runner V2] Fix slot_mapping after #25954 (#33046) · edf927bc
  Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  edf927bc
25 Jan, 2026 1 commit
- [Model] Use mm_position to compute mrope positions for Qwen2.5-Omni (#32772) · a698e8e7
  Itay Etelis authored Jan 25, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
  a698e8e7
24 Jan, 2026 4 commits

[Feature] add session based streaming input support to v1 (#28973) · 91601ff4

Joshua Deng authored Jan 24, 2026


Signed-off-by: Joshua Deng <joshuakdeng@gmail.com>
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

91601ff4

feat(benchmark): add encoder forward pass benchmarking to mm-processor (#31655) · 06b557ec

Reagan Lee authored Jan 24, 2026

Signed-off-by: Reagan <reaganjlee@gmail.com>
Signed-off-by: Reagan Lee <96998476+reaganjlee@users.noreply.github.com>
Co-authored-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>

06b557ec

[Perf] Cache xpu_get_mem_info() result to avoid duplicate calls (#32983) · 14d03b8d
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
14d03b8d

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

23 Jan, 2026 4 commits
- [cudagraphs] Refactor cudagraph capture loop (#32946) · 3a414595
  Lucas Wilkinson authored Jan 23, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3a414595
- [Model Runner V2] Add KV Connector support (#32742) · 8518b304
  Nick Hill authored Jan 23, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  8518b304
- [Bugfix][CI] Fix pre-commit (#32956) · 2d6b5371
  Matthew Bonanni authored Jan 23, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2d6b5371
- [V1][Hybrid] Mamba Prefix Caching with align mode (#30877) · 5206e5e2
  Harry Huang authored Jan 24, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  5206e5e2
22 Jan, 2026 3 commits
- [Refactor] Remove unused tpu files (#32610) · f7448101
  Wentao Ye authored Jan 22, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f7448101
- [CPU Backend] [Perf] Accelerate tensor-parallel/data-parallel inference across... · 744ef304
  Fadi Arafeh authored Jan 22, 2026
```
[CPU Backend] [Perf] Accelerate tensor-parallel/data-parallel inference across NUMA domains on Arm (#32792)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  744ef304
- [Model Runner V2] Do not error on attention backends (#32820) · 5e00b561
  Woosuk Kwon authored Jan 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  5e00b561
21 Jan, 2026 3 commits
- [Model Runner V2] Refactor Prompt Logprobs (#32811) · 408195ec
  Woosuk Kwon authored Jan 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  408195ec
- [Model Runner V2] Minor refactor for `compute_slot_mappings` (#32794) · e1da249c
  Woosuk Kwon authored Jan 21, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e1da249c
- [Cleanup] Remove unused `KVConnectorModelRunnerMixin` methods (#32077) · 6f067b1f
  Nick Hill authored Jan 20, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  6f067b1f
20 Jan, 2026 7 commits
- [Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408
  Lucas Wilkinson authored Jan 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  22613408
- [Model Runner V2] Support FLASHINFER_MLA backend (#32709) · 9ab4388c
  Woosuk Kwon authored Jan 20, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9ab4388c
- [Model Runner V2] Skip kernel launch for penalties & logit_bias (#32634) · e9c83cdc
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e9c83cdc
- [Model] Use context managers for encoder- and LM-only mode (#32605) · 4753f3bf
  Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4753f3bf
- [Model Runner V2] Decouple temperature from penalties (#32629) · 6c01ffb8
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6c01ffb8
- [Model Runner V2] Refactor get_cudagraph_and_dp_padding (#32625) · 7b7cdce9
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7b7cdce9
- [Model Runner V2] Initialized communication buffer for DP (#32624) · 05dc4bfa
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  05dc4bfa
19 Jan, 2026 5 commits
- [Model Runner V2] Refactor `dummy_run` (#32533) · 43fada53
  Woosuk Kwon authored Jan 19, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  43fada53
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
- [Core] Whisper support `torch.compile` (#30385) · 74c583bc
  Nicolò Lucchesi authored Jan 19, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  74c583bc
- [Model Runner V2] Refactor `update_states` (#32562) · 9a1f16da
  Woosuk Kwon authored Jan 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9a1f16da
- [Model Runner V2] Support VLM (#32546) · bb1848cd
  Woosuk Kwon authored Jan 18, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bb1848cd
18 Jan, 2026 2 commits
- [Model Runner V2] Minor optimization for eagle input processing (#32535) · 963dc0b8
  Woosuk Kwon authored Jan 17, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  963dc0b8
- [Model Runner V2] Move mrope_positions buffer to MRopeState (#32532) · 4147910f
  Woosuk Kwon authored Jan 17, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4147910f
16 Jan, 2026 1 commit
- [Bugfix] Refactor to support DP parallel in R3 (#32306) · 03da3b52
  Hongxin Xu authored Jan 16, 2026
```
Signed-off-by: xhx1022 <1737006628@qq.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>
```
  03da3b52
15 Jan, 2026 2 commits
- [Model Runner V2] Support FlashInfer backend & Fix CUDA Graph bug [1/2] (#32348) · 6218034d
  Woosuk Kwon authored Jan 15, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6218034d
- [2/N] Move cache factories to MM registry (#32382) · cbbae38f
  Cyrus Leung authored Jan 15, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbbae38f
14 Jan, 2026 4 commits
- [Misc] Make mem utils can be reused by other platforms (#32322) · ce094624
  Shanshan Shen authored Jan 14, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  ce094624
- [Refactor] Move top-level dummy data generation to registry (#32310) · 90db5b31
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  90db5b31
- [misc] Remove is_torch_equal_or_newer(2.4) cases (#32296) · 79336380
  Angela Yi authored Jan 13, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  79336380
- [Model Runner V2] Refactor Sampler (#32245) · 90c08369
  Woosuk Kwon authored Jan 13, 2026
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  90c08369