Commits · d76fc11ef5d40f86019811873ae340c8dcb64e3a · OpenDAS / vllm_cscc

26 Jan, 2026 3 commits

[GLM-OCR] GLM-OCR with MTP Support (#33005) · bb17e8f1

Yuxuan Zhang authored Jan 26, 2026


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

bb17e8f1

[Model] Use mm_position to compute mrope positions for Qwen3-Omni (#33010) · 6ca2c91b
Itay Etelis authored Jan 26, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
6ca2c91b

[StepVL] add step vl offline example (#33054) · b40db4df

ltd0924 authored Jan 26, 2026


Signed-off-by: luotingdan <luotingdan@stepfun.com>
Co-authored-by: luotingdan <luotingdan@stepfun.com>

b40db4df

25 Jan, 2026 1 commit
- [Model] Use mm_position to compute mrope positions for Qwen2.5-Omni (#32772) · a698e8e7
  Itay Etelis authored Jan 25, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
```
  a698e8e7
21 Jan, 2026 2 commits
- [Quantization][Deprecation] Remove `DeepSpeedFp8` (#32679) · cea3c754
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  cea3c754
- [Model] Add Eagle2.5-8B Vision-Language Model support (#32456) · 7727ce35
  Kim Hee Su authored Jan 21, 2026
```
Signed-off-by: kimheesu <wlskaka4@gmail.com>
```
  7727ce35
19 Jan, 2026 2 commits
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
- [Frontend] Score entrypoint support data_1 & data_2 and queries & documents as inputs (#32577) · c88860d7
  wang.yuqi authored Jan 19, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  c88860d7
18 Jan, 2026 1 commit
- [Bugfix] Fix GLM-ASR audio encoder RoPE dim (#32540) · 38bf2ffb
  Isotr0py authored Jan 18, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  38bf2ffb
14 Jan, 2026 1 commit

Add Molmo2 multimodal model support (#30997) · 7e6f1238

sangho.lee authored Jan 13, 2026


Signed-off-by: sanghol <sanghol@allenai.org>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

7e6f1238

12 Jan, 2026 2 commits
- [MODEL] New model support for kakaocorp/kanana-1.5-v-3b-instruct (#29384) · 6bc9c847
  Jaehyun An authored Jan 13, 2026
```
Signed-off-by: Jaehyun An <steve.ai@kakaocorp.com>
```
  6bc9c847
- [Bugfix] Fix missing scale passing for encoder Triton Attention implementation (#32149) · 9dbe1fe9
  Isotr0py authored Jan 12, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  9dbe1fe9
11 Jan, 2026 1 commit
- fix offline inference chat response prompt (#32088) · d74132ca
  Ning Xie authored Jan 11, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d74132ca
10 Jan, 2026 1 commit
- [Bugfix] fix offline chat output prompt (#32076) · 14fc7a68
  Ning Xie authored Jan 10, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  14fc7a68
09 Jan, 2026 1 commit
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
08 Jan, 2026 1 commit

[Model] Add LFM2-VL model support (#31758) · 03fd76c5

tianshu-Michael-yu authored Jan 08, 2026


Signed-off-by: Tianshu Yu <tianshuyu.formal@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

03fd76c5

06 Jan, 2026 1 commit
- [Doc] Show that `use_audio_in_video` is supported in docs (#30837) · da71d444
  Cyrus Leung authored Jan 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  da71d444
31 Dec, 2025 2 commits

[Audio] Improve Audio Inference Scripts (offline/online) (#29279) · adcf682f
Ekagra Ranjan authored Dec 31, 2025
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
adcf682f

Add GLM-ASR multimodal support (#31436) · d722e9e6

baonudesifeizhai authored Dec 31, 2025

Signed-off-by: baonudesifeizhai <baonudesifeizhai@gmail.com>
Signed-off-by: baonudesifeizhai <85092850+baonudesifeizhai@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

d722e9e6

27 Dec, 2025 1 commit
- [Chore]: Remove HF format Phi4-MM examples (#31405) · 40a87562
  Isotr0py authored Dec 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  40a87562
22 Dec, 2025 1 commit
- [CI] Fix "2 Node Tests (4 GPUs in total)" (#31090) · 7e065eba
  Lucas Wilkinson authored Dec 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  7e065eba
20 Dec, 2025 1 commit
- [CI] Fix H200 Distributed test (#31054) · ae0770fa
  Lucas Wilkinson authored Dec 20, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  ae0770fa
15 Dec, 2025 1 commit

[New Model] BAGEL support (AR only) (#28439) · 1adeb3b8

汪志鹏 authored Dec 15, 2025


Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

1adeb3b8

14 Dec, 2025 1 commit

Add AudioFlamingo3 model support (#30539) · 3a20450d

Lasha Koroshinadze authored Dec 14, 2025


Signed-off-by: Lasha <26011196+lashahub@users.noreply.github.com>
Signed-off-by: Lasha Koroshinadze <26011196+lashahub@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3a20450d

12 Dec, 2025 1 commit
- [CI/Build] Use spawn subprocess for ROCm (#30272) · 197473c4
  Ryan Rock authored Dec 11, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  197473c4
11 Dec, 2025 2 commits
- [ROCM][CI] Fix AMD Examples Test Group (#30276) · 2cc5affc
  Concurrensee authored Dec 11, 2025
```
Signed-off-by: Yida Wu <yida.wu@amd.com>
Signed-off-by: Yida <yida.wu@amd.com>
```
  2cc5affc
- [Deprecation] Remove deprecated task, seed and MM settings (#30397) · 7e24e5d4
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7e24e5d4
09 Dec, 2025 2 commits

[Cleanup] Refactor profiling env vars into a CLI config (#29912) · e858bfe0

Benjamin Chislett authored Dec 09, 2025

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e858bfe0

kv_transfer: Rename the shared storage connectors (#30201) · 4c6fd258
Or Ozeri authored Dec 09, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
4c6fd258

05 Dec, 2025 1 commit
- [Misc] Rename CohereForAI references to CohereLabs (#30147) · 3633035a
  Russell Bryant authored Dec 05, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  3633035a
04 Dec, 2025 1 commit
- fix LoRA-related examples (#29956) · 33a3d6c7
  Iceber Gu authored Dec 04, 2025
```
Signed-off-by: Iceber Gu <caiwei95@hotmail.com>
```
  33a3d6c7
03 Dec, 2025 1 commit

[Bugfix] Fix incorrect `image_grid_thw` rank for HunyuanOCR from missing... · a21cd9ed

Isotr0py authored Dec 03, 2025


[Bugfix] Fix incorrect `image_grid_thw` rank for HunyuanOCR from missing `merge_by_field_config=True` (#29950)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

a21cd9ed

02 Dec, 2025 3 commits

Fix some more Transformers nightly tests (#29872) · 6fc5841d
Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
6fc5841d

[examples] Resettle pooling examples. (#29365) · 2eb4fe91

wang.yuqi authored Dec 02, 2025

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2eb4fe91

[Core] Support reseting all running requests' KV while calling `reset_prefix_cache` (#28827) · d0cd7289

Zhuohan Li authored Dec 01, 2025


Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

d0cd7289

29 Nov, 2025 1 commit

[LoRA] Cleanup LoRA unused code (#29611) · 39e63dec

Jee Jee Li authored Nov 29, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39e63dec

25 Nov, 2025 3 commits

Attempt to fix GPU OOM in a spec-decoding test (#29419) · c32a18cb
Eldar Kurtić authored Nov 25, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
c32a18cb
Add TP CLI argument to multimodal inference examples (#29301) · a21256c4
Fanli Lin authored Nov 25, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
a21256c4

[Model] Add HunyuanOCR support (#29327) · 92effb07

Isotr0py authored Nov 25, 2025


Signed-off-by: manayang <jackmanayang@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: sergeywang <sergeywang@tencent.com>
Co-authored-by: manayang <jackmanayang@gmail.com>
Co-authored-by: manayang <manayang@tencent.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

92effb07

24 Nov, 2025 1 commit

[Multimodal][Qwen3 Omni] Make Qwen3 Omni work with audio-in-video inputs in V1 engine. (#27721) · 839c6b7b

Chenheli Hua authored Nov 24, 2025


Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>

839c6b7b