Commits · 89a385d79fb511f439f8ebe9d38d6811b5b24a91 · OpenDAS / vllm_cscc

07 Feb, 2026 1 commit

[Feat][RL] Pause and Resume with keep requests for single engine (#32351) · 89a385d7

Aaron Hao authored Feb 06, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

89a385d7

06 Feb, 2026 1 commit

[Docs] Improve documentation (#33799) · 6e7b1c4b

SorenDreano authored Feb 06, 2026


Co-authored-by: Soren Dreano <soren@numind.ai>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

6e7b1c4b

05 Feb, 2026 3 commits

[Spec Decode] Unified Parallel Drafting (#32887) · af3162d3
Benjamin Chislett authored Feb 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
af3162d3

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943) · c1858b7e

Aaron Hao authored Feb 05, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: SumanthRH <sumanthrh99@gmail.com>

c1858b7e

feat: Add ColBERT late interaction model support (#33686) · 439afa4e

Ilya Boytsov authored Feb 05, 2026


Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
Signed-off-by: Ilya Boytsov <boytsovpanamera@mail.ru>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

439afa4e

04 Feb, 2026 1 commit
- [Frontend][4/n] Make pooling entrypoints request schema consensus | ScoreRequest (#33060) · 1b8fe6f7
  wang.yuqi authored Feb 04, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  1b8fe6f7
03 Feb, 2026 4 commits

[Voxtral Realtime] Change name (#33716) · 3f7662d6
Patrick von Platen authored Feb 03, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
3f7662d6

[P/D] rework mooncake connector and introduce its bootstrap server (#31034) · 0d6ccf68

dtc authored Feb 04, 2026


Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

0d6ccf68

[Models] Intern-S1-Pro (#33636) · a3acfa10

zxy authored Feb 03, 2026


Signed-off-by: zxy <zhou0493@e.ntu.edu.sg>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a3acfa10

[Refactor] Clean up pooling serial utils (#33665) · 83449a5f
Cyrus Leung authored Feb 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
83449a5f

02 Feb, 2026 4 commits

[Model] Use mm_position to compute mrope positions for GLM-4.xV (#33039) · 199e3cb4
Yang Liu authored Feb 02, 2026
```
Signed-off-by: Yang <lymailforjob@gmail.com>
```
199e3cb4
[Bugfix] Enable Kimi k25 processor test (#33562) · 4061dcf4
Isotr0py authored Feb 02, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
4061dcf4

[Misc] support arbitrary MM datasets in spec dec bench (#33486) · ba871fb7

Komal Kumar Teru authored Feb 02, 2026


Signed-off-by: kkt-cohere <komal@cohere.com>
Signed-off-by: Komal Kumar Teru <162363718+kkt-cohere@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ba871fb7

[Model] Support DeepSeek-OCR-2 (#33165) · 808dd87b

RED authored Feb 02, 2026


Signed-off-by: liuli <ll407707@alibaba-inc.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: liuli <ll407707@alibaba-inc.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

808dd87b

31 Jan, 2026 3 commits
- [Frontend] Use new Renderer for Completions and Tokenize API (#32863) · f0a1c845
  Cyrus Leung authored Jan 31, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f0a1c845
- [UX] Use gguf `repo_id:quant_type` syntax for examples and docs (#33371) · 29fba767
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  29fba767
- [Misc] Algin Qwen3-VL-embedding image example outputs with HF repo example (#33419) · 9df152bb
  Isotr0py authored Jan 31, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9df152bb
30 Jan, 2026 5 commits

[Realtime API] Adds minimal realtime API based on websockets (#33187) · 10152d21
Patrick von Platen authored Jan 30, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
10152d21

[model] Add support for openPangu7B-VL (#32449) · ba45bedf

hujiaxin0 authored Jan 30, 2026

Signed-off-by: hujiaxin <524446785@qq.com>
Signed-off-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
Co-authored-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>

ba45bedf

Explicitly set `return_dict` for `apply_chat_template` (#33372) · 9432ed8c
Harry Mellor authored Jan 30, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
9432ed8c

[CI][AMD] Skip 4 GPUs testgroup ray tests (#33305) · 070c811d

Ryan Rock authored Jan 29, 2026


Signed-off-by: Ryan Rock <ryan.rock@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

070c811d

[Model][Multimodal] Add explicit MusicFlamingo adapter (#32696) · c46b0cd0
Wang Haoyu authored Jan 30, 2026
```
Signed-off-by: WangHaoyuuu <mailwhaoyu@gmail.com>
```
c46b0cd0

29 Jan, 2026 2 commits

[Models] Qwen3-ASR (#33312) · 8b3f0a99
Roger Wang authored Jan 29, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
8b3f0a99

[Bugfix] Fix Qwen3-VL-Reranker load. (#33298) · abb34ac4

wang.yuqi authored Jan 29, 2026

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

abb34ac4

28 Jan, 2026 2 commits

Adds FunAudioChat multimodal audio model support (#2) (#33058) · 36d450e3

ramos authored Jan 28, 2026


Signed-off-by: ramos <49182011+nemoramo@users.noreply.github.com>
Signed-off-by: mayufeng <mayufeng@example.com>
Co-authored-by: mayufeng <mayufeng@example.com>

36d450e3

Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2eb673a0

26 Jan, 2026 5 commits

[Logging] add `--disable-access-log-for-endpoints` CLI option (#30011) · 6ee7f18f

Jared Wen authored Jan 27, 2026



Add a new CLI option --disable-access-log-for-endpoints to suppress
uvicorn access logs for specified endpoints (e.g., /health, /metrics, /ping).

This addresses the need to reduce log noise in production environments
where health check endpoints are frequently polled by load balancers or
monitoring systems, generating excessive log entries that obscure
meaningful request logs.

Fixes #29982
Signed-off-by: JaredforReal <w13431838023@gmail.com>

6ee7f18f

[GLM-OCR] GLM-OCR with MTP Support (#33005) · bb17e8f1

Yuxuan Zhang authored Jan 26, 2026


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

bb17e8f1

[Model] Use mm_position to compute mrope positions for Qwen3-Omni (#33010) · 6ca2c91b
Itay Etelis authored Jan 26, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
6ca2c91b

[StepVL] add step vl offline example (#33054) · b40db4df

ltd0924 authored Jan 26, 2026


Signed-off-by: luotingdan <luotingdan@stepfun.com>
Co-authored-by: luotingdan <luotingdan@stepfun.com>

b40db4df

[Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955) · 11b55687
Cyrus Leung authored Jan 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
11b55687

25 Jan, 2026 1 commit
- [Model] Use mm_position to compute mrope positions for Qwen2.5-Omni (#32772) · a698e8e7
  Itay Etelis authored Jan 25, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
  a698e8e7
23 Jan, 2026 2 commits

[ROCm][PD] Remove unused moriio connector proxy code (#32939) · 1cb4341f
Mark McLoughlin authored Jan 23, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
1cb4341f

[Frontend][3/n] Make pooling entrypoints request schema consensus |... · 05f3d714

wang.yuqi authored Jan 23, 2026


[Frontend][3/n] Make pooling entrypoints request schema consensus | EmbedRequest & ClassifyRequest (#32905)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

05f3d714

22 Jan, 2026 1 commit
- [Frontend][2/n] Make pooling entrypoints request schema consensus | ChatRequest (#32574) · 328cbb27
  wang.yuqi authored Jan 22, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  328cbb27
21 Jan, 2026 2 commits
- [Quantization][Deprecation] Remove `DeepSpeedFp8` (#32679) · cea3c754
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  cea3c754
- [Model] Add Eagle2.5-8B Vision-Language Model support (#32456) · 7727ce35
  Kim Hee Su authored Jan 21, 2026
```
Signed-off-by: kimheesu <wlskaka4@gmail.com>
```
  7727ce35
20 Jan, 2026 3 commits

[Doc] Update docs for MM model development with context usage (#32691) · 09194b90
Cyrus Leung authored Jan 21, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
09194b90

[Metrics] Complete removal of deprecated vllm:time_per_output_token_seconds metric (#32661) · bb917203

杨朱 · Kiki authored Jan 20, 2026



This PR completes the removal of the deprecated vllm:time_per_output_token_seconds
metric that was deprecated in v0.11, hidden in v0.12, scheduled for removal in v0.13,
but delayed until v0.15.
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Haiku 4.5 <noreply@anthropic.com>

bb917203

[Model] Use context managers for encoder- and LM-only mode (#32605) · 4753f3bf
Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
4753f3bf