Commits · 58cb55e4def7ca45a1db52d967aee44fc28f959d · OpenDAS / vllm_cscc

30 Jan, 2026 8 commits
- [Misc] Clean up HIDDEN_DEPRECATED_METRICS after metric removal (#33323) · cf896ae0
  杨朱 · Kiki authored Jan 30, 2026
```
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  cf896ae0
- Remove deprecated `reasoning_content` message field (#33402) · c5113f60
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c5113f60
- [Realtime API] Adds minimal realtime API based on websockets (#33187) · 10152d21
  Patrick von Platen authored Jan 30, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  10152d21
- [Refactor] Move MM item count validation outside of processor (#33396) · c87eac18
  Cyrus Leung authored Jan 30, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c87eac18
- [model] Add support for openPangu7B-VL (#32449) · ba45bedf
  hujiaxin0 authored Jan 30, 2026
```
Signed-off-by: hujiaxin <524446785@qq.com>
Signed-off-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
Co-authored-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
```
  ba45bedf
- Explicitly set `return_dict` for `apply_chat_template` (#33372) · 9432ed8c
  Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9432ed8c
- [CI][AMD] Skip 4 GPUs testgroup ray tests (#33305) · 070c811d
  Ryan Rock authored Jan 29, 2026
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  070c811d
- [Model][Multimodal] Add explicit MusicFlamingo adapter (#32696) · c46b0cd0
  Wang Haoyu authored Jan 30, 2026
```
Signed-off-by: WangHaoyuuu <mailwhaoyu@gmail.com>
```
  c46b0cd0
29 Jan, 2026 11 commits
- [Chore] Move `MediaConnector` to `vllm.multimodal.media` (#33324) · 831453fc
  Cyrus Leung authored Jan 30, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  831453fc
- [Multimodal] Simplify MM input definitions (#33331) · c6e7404c
  Cyrus Leung authored Jan 29, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c6e7404c
- [Models] Qwen3-ASR (#33312) · 8b3f0a99
  Roger Wang authored Jan 29, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  8b3f0a99
- [Voxtral] Streaming example (#33042) · 40c35038
  Patrick von Platen authored Jan 29, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  40c35038
- [Bug Fix] Handle variable-length tensors in MultiModalFlatField batching (#31751) · 615e8033
  andrii.pasternak authored Jan 29, 2026
```
Signed-off-by: Andrii Pasternak <andriipasternak31@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
```
  615e8033
- [fix] tesdt mcp_tool_calling_streaming with a more complex math question (#32769) · 8688c3d4
  daniel-salib authored Jan 29, 2026
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
```
  8688c3d4
- [Misc] Cleanup Kimi-K2.5's vision chunk modality entrypoints (#33157) · 3a92c6f3
  Isotr0py authored Jan 29, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3a92c6f3
- Adding optional speculator tests for larger models (#32943) · 5eeba80c
  shanjiaz authored Jan 29, 2026
```
Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
```
  5eeba80c
- support returning tokenids in responses api (#33212) · 3bba2edb
  cmunley1 authored Jan 29, 2026
```
Signed-off-by: Christian Munley <cmunley@nvidia.com>
```
  3bba2edb
- [Bugfix] Fix Qwen3-VL-Reranker load. (#33298) · abb34ac4
  wang.yuqi authored Jan 29, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  abb34ac4
- [Refactor] Define MM data parser in processing info instead of processor itself (#33260) · 51550179
  Cyrus Leung authored Jan 29, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51550179
28 Jan, 2026 10 commits

[UX] Enable nested configs in config yaml files (#33193) · ca196918
Michael Goin authored Jan 28, 2026

ca196918
Use aiter triton fused_add_rmsnorm_pad for gpt-oss (#30976) · 59bcc5b6
Rohan Potdar authored Jan 28, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
59bcc5b6

[Feature] Fully support for async scheduling + PP, 30.8% E2E throughput... · 3e440786

Wentao Ye authored Jan 28, 2026


[Feature] Fully support for async scheduling + PP, 30.8% E2E throughput improvement, 31.8% TPOT improvement (#32618)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

3e440786

[CI] Whisper tests `enforce_eager=False` (#33098) · 8ebf372e
Nicolò Lucchesi authored Jan 28, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
8ebf372e

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

[Misc] Provide a DeepSeek ReasoningParser with thinking enabled by default (#33221) · 8e5e40da
Chauncey authored Jan 28, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
8e5e40da
Revert "Enable Cross layers KV cache layout at NIXL Connector (#30207)" (#33241) · 2e8de867
Or Ozeri authored Jan 28, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Kevin H. Luu <khluu000@gmail.com>
```
2e8de867

[Quantization][Deprecation] Remove BitBlas (#32683) · 247d1a32

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

247d1a32

Adds FunAudioChat multimodal audio model support (#2) (#33058) · 36d450e3

ramos authored Jan 28, 2026


Signed-off-by: ramos <49182011+nemoramo@users.noreply.github.com>
Signed-off-by: mayufeng <mayufeng@example.com>
Co-authored-by: mayufeng <mayufeng@example.com>

36d450e3

Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2eb673a0

27 Jan, 2026 10 commits

[torch.compile] Speed up MOE handling in forward_context (#33184) · d9aa39a3
Richard Zou authored Jan 27, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
d9aa39a3

Support heterogeneous NemotronHPuzzle model (#32549) · 83fb2d09

danielafrimi authored Jan 27, 2026



Signed-off-by: <dafrimi@nvidia.com>
Signed-off-by: Daniel Afrimi <dafrimi@nvidia.com>
Signed-off-by: root <dafrimi@nvidia.com>

83fb2d09

[5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
a608b4c6

[Metrics] [KVConnector] Add Offloading Connector metrics (#27942) · 7227d061

omerpaz95 authored Jan 27, 2026



Added queries and hits metrics for the Offloading Connector.

Also added timing metrics for store and load operations, which take the
average time it takes to load/store, per-token.

The metrics are available from Prometheus and from the StatLogger.
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Omer Paz <Omer.Paz@ibm.com>

7227d061

Fix weight mapping test for Transfomers v5 (#33162) · 14385c80
Harry Mellor authored Jan 27, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
14385c80

[Frontend] Frontend will only attach supported tasks corresponding entrypoints. (#33139) · 76139d08

wang.yuqi authored Jan 27, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

76139d08

[Models] Kimi-K2.5 (#33131) · b539f988

Roger Wang authored Jan 26, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wanglinian <wanglinian@stu.pku.edu.cn>
Co-authored-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b539f988

[CI][Pooling] Stabilize ModernBERT test (#32909) · 6c006457
Andreas Karatzas authored Jan 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
6c006457

fix: preserve native tool call ID in multi-turn tool calling (#32768) · 2d705343

wangln19 authored Jan 27, 2026


Signed-off-by: wanglinian <wanglinian@stu.pku.edu.cn>
Signed-off-by: wangln19 <96399074+wangln19@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <2037008807@qq.com>

2d705343

[MoE Refactor] Integrate Naive Prepare Finalize into MK (#32567) · 5a93b916

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: amirkl94 <203507526+amirkl94@users.noreply.github.com>

5a93b916

26 Jan, 2026 1 commit

[Logging] add `--disable-access-log-for-endpoints` CLI option (#30011) · 6ee7f18f

Jared Wen authored Jan 27, 2026



Add a new CLI option --disable-access-log-for-endpoints to suppress
uvicorn access logs for specified endpoints (e.g., /health, /metrics, /ping).

This addresses the need to reduce log noise in production environments
where health check endpoints are frequently polled by load balancers or
monitoring systems, generating excessive log entries that obscure
meaningful request logs.

Fixes #29982
Signed-off-by: JaredforReal <w13431838023@gmail.com>

6ee7f18f