Commits · 7e6f12381092cd0b457ad10c57fa48ca73c415a7 · OpenDAS / vllm_cscc

14 Jan, 2026 1 commit

Add Molmo2 multimodal model support (#30997) · 7e6f1238

sangho.lee authored Jan 13, 2026


Signed-off-by: sanghol <sanghol@allenai.org>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7e6f1238

13 Jan, 2026 2 commits
- [Misc] Add In-Container restart capability through supervisord for sagemaker entrypoint (#28502) · 2f4a71da
  HappyAmazonian authored Jan 13, 2026
```
Signed-off-by: Shen Teng <sheteng@amazon.com>
Signed-off-by: HappyAmazonian <91216626+HappyAmazonian@users.noreply.github.com>
```
  2f4a71da
- [Bugfix] Replace `PoolingParams.normalize` with `use_activation` (#32243) · 232214b2
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  232214b2
12 Jan, 2026 3 commits
- [MODEL] New model support for kakaocorp/kanana-1.5-v-3b-instruct (#29384) · 6bc9c847
  Jaehyun An authored Jan 13, 2026
```
Signed-off-by: Jaehyun An <steve.ai@kakaocorp.com>
```
  6bc9c847
- [Bugfix] Fix missing scale passing for encoder Triton Attention implementation (#32149) · 9dbe1fe9
  Isotr0py authored Jan 12, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9dbe1fe9
- [Model] Improve multimodal pooling examples (#32085) · 60446cd6
  wang.yuqi authored Jan 12, 2026
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  60446cd6
11 Jan, 2026 1 commit
- fix offline inference chat response prompt (#32088) · d74132ca
  Ning Xie authored Jan 11, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d74132ca
10 Jan, 2026 1 commit
- [Bugfix] fix offline chat output prompt (#32076) · 14fc7a68
  Ning Xie authored Jan 10, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  14fc7a68
09 Jan, 2026 3 commits
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
- [Doc] Remove hardcoded Whisper in example openai translation client (#32027) · 2d0c5b63
  Isotr0py authored Jan 09, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  2d0c5b63
- [ROCm][PD] add moriio kv connector. (#29304) · 4505849b
  inkcherry authored Jan 09, 2026
```
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
```
  4505849b
08 Jan, 2026 2 commits

[Model] Add LFM2-VL model support (#31758) · 03fd76c5

tianshu-Michael-yu authored Jan 08, 2026


Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

03fd76c5

[Models] Allow converting Qwen3-VL into Reranker model (#31890) · eac3b96e
Isotr0py authored Jan 08, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
eac3b96e

06 Jan, 2026 2 commits
- [Model] rename use_pad_token to use_sep_token (#31784) · 96860af6
  wang.yuqi authored Jan 06, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  96860af6
- [Doc] Show that `use_audio_in_video` is supported in docs (#30837) · da71d444
  Cyrus Leung authored Jan 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  da71d444
05 Jan, 2026 2 commits
- Fix GLM-4.6v flash tool calling in transformers 5.x (#31622) · 02dbb933
  baonudesifeizhai authored Jan 05, 2026
```
Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
```
  02dbb933
- [Model] Let more models to support the score template. (#31335) · 911d38ed
  wang.yuqi authored Jan 05, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  911d38ed
02 Jan, 2026 1 commit
- Add multimodal input method in the documentation (#31601) · a01f2fae
  labAxiaoming authored Jan 02, 2026
```
Signed-off-by: xiaoming <1259730330@qq.com>
```
  a01f2fae
31 Dec, 2025 2 commits

[Audio] Improve Audio Inference Scripts (offline/online) (#29279) · adcf682f
Ekagra Ranjan authored Dec 31, 2025
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
adcf682f

Add GLM-ASR multimodal support (#31436) · d722e9e6

baonudesifeizhai authored Dec 31, 2025

Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

d722e9e6

30 Dec, 2025 1 commit

[Prefix Cache] Include lora_name in BlockStored event for deterministic... · 39512aba

Sage authored Dec 30, 2025


[Prefix Cache] Include lora_name in BlockStored event for deterministic KV-cache reconstruction (#27577)
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
Co-authored-by: Sage <80211083+sagiahrac@users.noreply.github.com>

39512aba

27 Dec, 2025 1 commit
- [Chore]: Remove HF format Phi4-MM examples (#31405) · 40a87562
  Isotr0py authored Dec 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  40a87562
25 Dec, 2025 1 commit
- [Frontend] add FunctionGemma tool parser support (#31218) · ba25a659
  Mark Gatere authored Dec 25, 2025
```
Signed-off-by: gateremark <gateremg@gmail.com>
```
  ba25a659
23 Dec, 2025 1 commit

[Frontend] Support using chat template as custom score template for reranking models (#30550) · 23daef54

Jakub Zakrzewski authored Dec 23, 2025


Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: wang.yuqi <yuqi.wang@daocloud.io>

23daef54

22 Dec, 2025 2 commits
- [BugFix] skip language model in Encoder (#30242) · 8f8f469b
  dengyunyang authored Dec 22, 2025
```
Signed-off-by: dengyunyang <584797741@qq.com>
```
  8f8f469b
- [CI] Fix "2 Node Tests (4 GPUs in total)" (#31090) · 7e065eba
  Lucas Wilkinson authored Dec 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  7e065eba
20 Dec, 2025 1 commit
- [CI] Fix H200 Distributed test (#31054) · ae0770fa
  Lucas Wilkinson authored Dec 20, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  ae0770fa
18 Dec, 2025 1 commit

Remove all2all backend envvar (#30363) · 41b6f920

Elizabeth Thomas authored Dec 18, 2025

Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

41b6f920

15 Dec, 2025 1 commit

[New Model] BAGEL support (AR only) (#28439) · 1adeb3b8

汪志鹏 authored Dec 15, 2025


Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

1adeb3b8

14 Dec, 2025 2 commits

Add AudioFlamingo3 model support (#30539) · 3a20450d

Lasha Koroshinadze authored Dec 14, 2025


Signed-off-by: Lasha <26011196+lashahub@users.noreply.github.com>
Signed-off-by: Lasha Koroshinadze <26011196+lashahub@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3a20450d

[Doc]: fixing typos in various files (#30540) · 1a55cfaf

Didier Durand authored Dec 14, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

1a55cfaf

12 Dec, 2025 1 commit
- [CI/Build] Use spawn subprocess for ROCm (#30272) · 197473c4
  Ryan Rock authored Dec 11, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  197473c4
11 Dec, 2025 4 commits
- [FIX]Patch run-cluster.sh (fix for #28328) (#30002) · d527cf0b
  Ev Lacey authored Dec 11, 2025
```
Signed-off-by: elacey <elacey@nvidia.com>
Signed-off-by: Ev Lacey <github@everettlacey.com>
```
  d527cf0b
- [ROCM][CI] Fix AMD Examples Test Group (#30276) · 2cc5affc
  Concurrensee authored Dec 11, 2025
```
Signed-off-by: Yida Wu <yida.wu@amd.com>
Signed-off-by: Yida <yida.wu@amd.com>
```
  2cc5affc
- Give pooling examples better names (#30488) · 93db3256
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  93db3256
- [Deprecation] Remove deprecated task, seed and MM settings (#30397) · 7e24e5d4
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7e24e5d4
09 Dec, 2025 3 commits

[Cleanup] Refactor profiling env vars into a CLI config (#29912) · e858bfe0

Benjamin Chislett authored Dec 09, 2025

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e858bfe0

kv_transfer: Rename the shared storage connectors (#30201) · 4c6fd258
Or Ozeri authored Dec 09, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
4c6fd258
[Disagg] Support large batch size in proxy server and update NixlConnector doc for DP (#28782) · 60d17251
Ming Yang authored Dec 08, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
60d17251

08 Dec, 2025 1 commit

[Frontend] Binary embedding response does not return metadata by setting... · 2e660c24

wang.yuqi authored Dec 08, 2025


[Frontend] Binary embedding response does not return metadata by setting encoding_format to bytes_only. (#30249)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2e660c24