Commits · 328cbb2773d93d45d18dfd383d631de4fa276e69 · OpenDAS / vllm_cscc

22 Jan, 2026 1 commit
- [Frontend][2/n] Make pooling entrypoints request schema consensus | ChatRequest (#32574) · 328cbb27
  wang.yuqi authored Jan 22, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  328cbb27
21 Jan, 2026 2 commits
- [Quantization][Deprecation] Remove `DeepSpeedFp8` (#32679) · cea3c754
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  cea3c754
- [Model] Add Eagle2.5-8B Vision-Language Model support (#32456) · 7727ce35
  Kim Hee Su authored Jan 21, 2026
```
Signed-off-by: kimheesu <wlskaka4@gmail.com>
```
  7727ce35
20 Jan, 2026 3 commits

[Doc] Update docs for MM model development with context usage (#32691) · 09194b90
Cyrus Leung authored Jan 21, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
09194b90

[Metrics] Complete removal of deprecated vllm:time_per_output_token_seconds metric (#32661) · bb917203

杨朱 · Kiki authored Jan 20, 2026



This PR completes the removal of the deprecated vllm:time_per_output_token_seconds
metric that was deprecated in v0.11, hidden in v0.12, scheduled for removal in v0.13,
but delayed until v0.15.
Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Haiku 4.5 <noreply@anthropic.com>

bb917203

[Model] Use context managers for encoder- and LM-only mode (#32605) · 4753f3bf
Cyrus Leung authored Jan 20, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
4753f3bf

19 Jan, 2026 2 commits
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
- [Frontend] Score entrypoint support data_1 & data_2 and queries & documents as inputs (#32577) · c88860d7
  wang.yuqi authored Jan 19, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  c88860d7
18 Jan, 2026 1 commit
- [Bugfix] Fix GLM-ASR audio encoder RoPE dim (#32540) · 38bf2ffb
  Isotr0py authored Jan 18, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  38bf2ffb
16 Jan, 2026 1 commit
- [Frontend][1/n] Make pooling entrypoints request schema consensus | CompletionRequest (#32395) · 4ae77dfd
  wang.yuqi authored Jan 16, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  4ae77dfd
14 Jan, 2026 1 commit

Add Molmo2 multimodal model support (#30997) · 7e6f1238

sangho.lee authored Jan 13, 2026


Signed-off-by: sanghol <sanghol@allenai.org>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7e6f1238

13 Jan, 2026 2 commits
- [Misc] Add In-Container restart capability through supervisord for sagemaker entrypoint (#28502) · 2f4a71da
  HappyAmazonian authored Jan 13, 2026
```
Signed-off-by: Shen Teng <sheteng@amazon.com>
Signed-off-by: HappyAmazonian <91216626+HappyAmazonian@users.noreply.github.com>
```
  2f4a71da
- [Bugfix] Replace `PoolingParams.normalize` with `use_activation` (#32243) · 232214b2
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  232214b2
12 Jan, 2026 3 commits
- [MODEL] New model support for kakaocorp/kanana-1.5-v-3b-instruct (#29384) · 6bc9c847
  Jaehyun An authored Jan 13, 2026
```
Signed-off-by: Jaehyun An <steve.ai@kakaocorp.com>
```
  6bc9c847
- [Bugfix] Fix missing scale passing for encoder Triton Attention implementation (#32149) · 9dbe1fe9
  Isotr0py authored Jan 12, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9dbe1fe9
- [Model] Improve multimodal pooling examples (#32085) · 60446cd6
  wang.yuqi authored Jan 12, 2026
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  60446cd6
11 Jan, 2026 1 commit
- fix offline inference chat response prompt (#32088) · d74132ca
  Ning Xie authored Jan 11, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d74132ca
10 Jan, 2026 1 commit
- [Bugfix] fix offline chat output prompt (#32076) · 14fc7a68
  Ning Xie authored Jan 10, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  14fc7a68
09 Jan, 2026 3 commits
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
- [Doc] Remove hardcoded Whisper in example openai translation client (#32027) · 2d0c5b63
  Isotr0py authored Jan 09, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2d0c5b63
- [ROCm][PD] add moriio kv connector. (#29304) · 4505849b
  inkcherry authored Jan 09, 2026
```
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
```
  4505849b
08 Jan, 2026 2 commits

[Model] Add LFM2-VL model support (#31758) · 03fd76c5

tianshu-Michael-yu authored Jan 08, 2026


Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

03fd76c5

[Models] Allow converting Qwen3-VL into Reranker model (#31890) · eac3b96e
Isotr0py authored Jan 08, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
eac3b96e

06 Jan, 2026 2 commits
- [Model] rename use_pad_token to use_sep_token (#31784) · 96860af6
  wang.yuqi authored Jan 06, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  96860af6
- [Doc] Show that `use_audio_in_video` is supported in docs (#30837) · da71d444
  Cyrus Leung authored Jan 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  da71d444
05 Jan, 2026 2 commits
- Fix GLM-4.6v flash tool calling in transformers 5.x (#31622) · 02dbb933
  baonudesifeizhai authored Jan 05, 2026
```
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
```
  02dbb933
- [Model] Let more models to support the score template. (#31335) · 911d38ed
  wang.yuqi authored Jan 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  911d38ed
02 Jan, 2026 1 commit
- Add multimodal input method in the documentation (#31601) · a01f2fae
  labAxiaoming authored Jan 02, 2026
```
Signed-off-by: xiaoming <1259730330@qq.com>
```
  a01f2fae
31 Dec, 2025 2 commits

[Audio] Improve Audio Inference Scripts (offline/online) (#29279) · adcf682f
Ekagra Ranjan authored Dec 31, 2025
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
adcf682f

Add GLM-ASR multimodal support (#31436) · d722e9e6

baonudesifeizhai authored Dec 31, 2025

Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

d722e9e6

30 Dec, 2025 1 commit

[Prefix Cache] Include lora_name in BlockStored event for deterministic... · 39512aba

Sage authored Dec 30, 2025


[Prefix Cache] Include lora_name in BlockStored event for deterministic KV-cache reconstruction (#27577)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Co-authored-by: Sage <80211083+sagiahrac@users.noreply.github.com>

39512aba

27 Dec, 2025 1 commit
- [Chore]: Remove HF format Phi4-MM examples (#31405) · 40a87562
  Isotr0py authored Dec 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  40a87562
25 Dec, 2025 1 commit
- [Frontend] add FunctionGemma tool parser support (#31218) · ba25a659
  Mark Gatere authored Dec 25, 2025
```
Signed-off-by: gateremark <gateremg@gmail.com>
```
  ba25a659
23 Dec, 2025 1 commit

[Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54

Jakub Zakrzewski authored Dec 23, 2025


Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

23daef54

22 Dec, 2025 2 commits
- [BugFix] skip language model in Encoder (#30242) · 8f8f469b
  dengyunyang authored Dec 22, 2025
```
Signed-off-by: dengyunyang <584797741@qq.com>
```
  8f8f469b
- [CI] Fix "2 Node Tests (4 GPUs in total)" (#31090) · 7e065eba
  Lucas Wilkinson authored Dec 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  7e065eba
20 Dec, 2025 1 commit
- [CI] Fix H200 Distributed test (#31054) · ae0770fa
  Lucas Wilkinson authored Dec 20, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  ae0770fa
18 Dec, 2025 1 commit

Remove all2all backend envvar (#30363) · 41b6f920

Elizabeth Thomas authored Dec 18, 2025

Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

41b6f920

15 Dec, 2025 1 commit

[New Model] BAGEL support (AR only) (#28439) · 1adeb3b8

汪志鹏 authored Dec 15, 2025


Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

1adeb3b8

14 Dec, 2025 1 commit

Add AudioFlamingo3 model support (#30539) · 3a20450d

Lasha Koroshinadze authored Dec 14, 2025


Signed-off-by: Lasha <26011196+lashahub@users.noreply.github.com>
Signed-off-by: Lasha Koroshinadze <26011196+lashahub@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3a20450d