Commits · f857a03f6b71101ac3f67b766f9a165c8b617f7b · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "fb7abfc1d03c93d07813946d84368002b2cac833"

30 Jan, 2026 5 commits
- [QeRL] Layerwise Reloading (#32133) · f857a03f
  Kyle Sayers authored Jan 30, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  f857a03f
- [Realtime API] Adds minimal realtime API based on websockets (#33187) · 10152d21
  Patrick von Platen authored Jan 30, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  10152d21
- [Misc] Replace Optional[X] with X | None syntax (#33332) · 1a7894db
  杨朱 · Kiki authored Jan 30, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  1a7894db
- [Refactor] Move MM item count validation outside of processor (#33396) · c87eac18
  Cyrus Leung authored Jan 30, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c87eac18
- [CI] Enable mypy import following for `vllm/spec_decode` (#33282) · 726d8972
  Lucas Kabela authored Jan 29, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  726d8972
29 Jan, 2026 5 commits
- [BUGFIX][XPU] fix memory check after XPU reuse GPU_worker (#33358) · 8c8ebeb9
  Chendi.Xue authored Jan 29, 2026
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
  8c8ebeb9
- [Multimodal] Simplify MM input definitions (#33331) · c6e7404c
  Cyrus Leung authored Jan 29, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c6e7404c
- [Intel GPU] refine xpu worker (#32894) · 8bb6271c
  Kunshang Ji authored Jan 29, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  8bb6271c
- Make `mypy` opt-out instead of opt-in (#33205) · fb946a7f
  Harry Mellor authored Jan 29, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  fb946a7f
- [Doc]: fixing multiple typos in diverse files (#33256) · 31b25f65
  Didier Durand authored Jan 29, 2026
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  31b25f65
28 Jan, 2026 7 commits

[ModelRunner V2] Misc code simplification and cleanup (#33266) · 6bf3b46d
Nick Hill authored Jan 28, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
6bf3b46d
[Bugfix] Add missing encoder only guard for do_kv_cache_update (#33269) · ab597c86
Gregory Shtrasberg authored Jan 28, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
ab597c86

[Feature] Fully support for async scheduling + PP, 30.8% E2E throughput... · 3e440786

Wentao Ye authored Jan 28, 2026


[Feature] Fully support for async scheduling + PP, 30.8% E2E throughput improvement, 31.8% TPOT improvement (#32618)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

3e440786

[ROCm] Enabling forward_includes_kv_cache on ROCm MHA backends (#33106) · 22ad6495
Gregory Shtrasberg authored Jan 28, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
22ad6495
[Bugfix] Lazy import NgramProposer in GPU model runner (#32821) · a2b877df
22quinn authored Jan 27, 2026
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
a2b877df
Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2eb673a0

[Model Runner V2] Use a different stream for grammar bitmask h2d copy (#33059) · 46ec6d71

Woosuk Kwon authored Jan 27, 2026


Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Nick Hill <nhill@redhat.com>

46ec6d71

27 Jan, 2026 10 commits

[Perf] Optimize dcp allocate tensor (#33102) · 3a6d5cbe
Wentao Ye authored Jan 27, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
3a6d5cbe

feature: support eagle3 for HunyuanVL & Hunyuan (#33035) · bd92089d

Iris authored Jan 28, 2026


Signed-off-by: irisliu10 <601012173@qq.com>
Signed-off-by: Iris <38269816+irisliu10@users.noreply.github.com>

bd92089d

[BugFix] Fix P/D with non-MoE DP (#33037) · 0cd259b2
Nick Hill authored Jan 27, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
0cd259b2

[Metrics][MFU] Fix UnembedMetrics FLOP overcounting for prefill (#33045) (#33045) · 5ec44056

omkhalil authored Jan 27, 2026

Fix UnembedMetrics to correctly count FLOPs for the unembedding (LM head) layer.

The bug: UnembedMetrics used total_num_tokens() which counts all tokens in the
batch for projection flops, vocab projections are run on just the last token for the
autoregressive use case.
Co-authored-by: Omar Mohamed Khalil <omarkhalil@meta.com>

5ec44056

[5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
a608b4c6
[Bugfix] Disable CG for Whisper+FA2 (#33164) · 1f3a2c29
Nicolò Lucchesi authored Jan 27, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
1f3a2c29

[Metrics] [KVConnector] Add Offloading Connector metrics (#27942) · 7227d061

omerpaz95 authored Jan 27, 2026



Added queries and hits metrics for the Offloading Connector.

Also added timing metrics for store and load operations, which take the
average time it takes to load/store, per-token.

The metrics are available from Prometheus and from the StatLogger.
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Omer Paz <Omer.Paz@ibm.com>

7227d061

[code clean] remove duplicate code (#33135) · b781eeaa
Ning Xie authored Jan 27, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
b781eeaa
Fix IndexError with encoder-decoder models when using Custom Paged Attention (#33112) · c568581f
Strahinja Stamenkovic authored Jan 27, 2026
```
Signed-off-by: sstamenk <strahinja.stamenkovic@amd.com>
```
c568581f

[Model Runner V2] Remove UvaBufferPool for cpu->gpu copy (#33055) · 6d86fde0

Woosuk Kwon authored Jan 26, 2026


Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Nick Hill <nhill@redhat.com>

6d86fde0

26 Jan, 2026 5 commits
- [GLM-OCR] GLM-OCR with MTP Support (#33005) · bb17e8f1
  Yuxuan Zhang authored Jan 26, 2026
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  bb17e8f1
- [Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
  Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  11b55687
- [Model Runner V2] Add LoRAState to consolidate lora logic (#33062) · a9b53dd4
  Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  a9b53dd4
- [Model Runner V2] Minor simplification for finish_requests (#33048) · 2f0d3ba7
  Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  2f0d3ba7
- [Model Runner V2] Fix slot_mapping after #25954 (#33046) · edf927bc
  Woosuk Kwon authored Jan 25, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
```
  edf927bc
25 Jan, 2026 1 commit
- [Model] Use mm_position to compute mrope positions for Qwen2.5-Omni (#32772) · a698e8e7
  Itay Etelis authored Jan 25, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
  a698e8e7
24 Jan, 2026 6 commits

[Feature] add session based streaming input support to v1 (#28973) · 91601ff4

Joshua Deng authored Jan 24, 2026


Signed-off-by: Joshua Deng <joshuakdeng@gmail.com>
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

91601ff4

[EncoderCacheManager] Remove unnecessary copy (#32800) · 5fa0f6ef
Lukas Geiger authored Jan 24, 2026
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
5fa0f6ef

feat(benchmark): add encoder forward pass benchmarking to mm-processor (#31655) · 06b557ec

Reagan Lee authored Jan 24, 2026

Signed-off-by: Reagan <reaganjlee@gmail.com>
Signed-off-by: Reagan Lee <96998476+reaganjlee@users.noreply.github.com>
Co-authored-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>

06b557ec

[Perf] Cache xpu_get_mem_info() result to avoid duplicate calls (#32983) · 14d03b8d
7. Sun authored Jan 24, 2026
```
Signed-off-by: 7. Sun <jhao.sun@gmail.com>
```
14d03b8d
[Core][Bugfix] allow graceful worker termination (#32965) · 7e1f10d5
Joe Runde authored Jan 23, 2026
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
7e1f10d5

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

23 Jan, 2026 1 commit

fix: Add glm4_moe_lite to MLA detection (#32614) · 586a57ad

Markus / Mark authored Jan 23, 2026


Signed-off-by: marksverdhei <marksverdhei@hotmail.com>
Signed-off-by: Markus / Mark <46672778+marksverdhei@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

586a57ad