Commits · c32a18cbe7342ac0700802b94ae98bbf928a00f0 · OpenDAS / vllm_cscc

25 Nov, 2025 3 commits

Attempt to fix GPU OOM in a spec-decoding test (#29419) · c32a18cb
Eldar Kurtić authored Nov 25, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
c32a18cb
Add TP CLI argument to multimodal inference examples (#29301) · a21256c4
Fanli Lin authored Nov 25, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
a21256c4

[Model] Add HunyuanOCR support (#29327) · 92effb07

Isotr0py authored Nov 25, 2025


Signed-off-by: manayang <jackmanayang@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: sergeywang <sergeywang@tencent.com>
Co-authored-by: manayang <jackmanayang@gmail.com>
Co-authored-by: manayang <manayang@tencent.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

92effb07

24 Nov, 2025 4 commits
- [Multimodal][Qwen3 Omni] Make Qwen3 Omni work with audio-in-video inputs in V1 engine. (#27721) · 839c6b7b
  Chenheli Hua authored Nov 24, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  839c6b7b
- [BugFix] Fix R-VL model loading error (#29299) · ed40d859
  Fanli Lin authored Nov 24, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  ed40d859
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
- [Bugfix] Update Gradio OpenAI Chatbot Webserver example to new Gradio message... · c309bb52
  Josh Moore authored Nov 23, 2025
```
[Bugfix] Update Gradio OpenAI Chatbot Webserver example to new Gradio message history format (#29249)
Signed-off-by: joshiemoore <joshiemoore98@gmail.com>
```
  c309bb52
23 Nov, 2025 1 commit
- [Doc] Update more docs with respect to V1 (#29188) · 389aa1b2
  Cyrus Leung authored Nov 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  389aa1b2
22 Nov, 2025 1 commit

[responsesAPI] parse reasoning item input (#28248) · 742e9ff6

Andrew Xia authored Nov 21, 2025


Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

742e9ff6

21 Nov, 2025 2 commits

[V0 deprecation] Remove more V0 references (#29088) · aab0102a
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
aab0102a

[Doc] cleanup TPU documentation and remove outdated examples (#29048) · dd39f91e

Rob Mulla authored Nov 20, 2025

Signed-off-by: Rob Mulla <rob.mulla@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

dd39f91e

20 Nov, 2025 1 commit
- [BugFix][PD]: make example proxy usable with P2pNcclConnector (#26628) · e5bfcb6a
  Pan Li authored Nov 21, 2025
```
Signed-off-by: PAN <1162953505@qq.com>
```
  e5bfcb6a
19 Nov, 2025 3 commits
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
- [Doc]: fix typos in various files (#28945) · 7ed27f3c
  Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7ed27f3c
- Move online quantization to `model.load_weights` (#26327) · da94c7c0
  Jerry Zhang authored Nov 18, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  da94c7c0
18 Nov, 2025 1 commit

[chore] Move the rest of wikimedia url to S3 (#28921) · c64c0b78

Kevin H. Luu authored Nov 18, 2025


Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c64c0b78

14 Nov, 2025 2 commits

Remove audio optional dependency for mistral-common (#28722) · 08542480

Julien Denize authored Nov 14, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

08542480

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

13 Nov, 2025 2 commits
- [Bugfix] Fix FPS value type for Qwen2.5-Omni video processing (#28630) · c9fe6abe
  Fanli Lin authored Nov 13, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  c9fe6abe
- [Frontend] supports interleaved thinking (#28531) · 5c9ad138
  Chauncey authored Nov 13, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  5c9ad138
12 Nov, 2025 2 commits

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56

Chenguang Zheng authored Nov 12, 2025


Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>

4ccffe56

[[V0 deprecation]]Remove VLLM_USE_V1 env (#28204) · e1710393
wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
e1710393

09 Nov, 2025 2 commits
- [Misc] fix typo and add detailed log (#28178) · e5e9067e
  Ning Xie authored Nov 09, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  e5e9067e
- [chore] Move some wikimedia images to S3 (#28351) · 05f8d690
  Kevin H. Luu authored Nov 08, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  05f8d690
08 Nov, 2025 2 commits
- Enhance run_cluster.sh for multi-NIC support (#28328) · 77d702a2
  Ev Lacey authored Nov 08, 2025
```
Signed-off-by: Ev Lacey <elacey@nvidia.com>
```
  77d702a2
- `reasoning_content` -> `reasoning` (#27752) · d9ab1ad9
  Harry Mellor authored Nov 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d9ab1ad9
06 Nov, 2025 2 commits
- [Doc]: Make extraInit containers fully configurable in helm chart (#27497) · da855b42
  Fang Han authored Nov 06, 2025
```
Signed-off-by: Fang Han <fhan0520@gmail.com>
```
  da855b42
- [Frontend] OpenAI Responses API supports Tool/Function calling - non-harmony (#26874) · 59a50afa
  Chauncey authored Nov 06, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  59a50afa
05 Nov, 2025 1 commit
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
03 Nov, 2025 1 commit

[Model] Add PaddleOCR-VL Model Support (#27758) · 40b69e33

zhang-prog authored Nov 03, 2025


Signed-off-by: zhangyue <zhangyue66@baidu.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: zhangyue66 <zhangyue66@baidu.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

40b69e33

30 Oct, 2025 1 commit

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f

wang.yuqi authored Oct 30, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4464723f

29 Oct, 2025 1 commit
- [CI/Build] Test torchrun with 8 cards (#27548) · f7a66828
  22quinn authored Oct 29, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  f7a66828
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

23 Oct, 2025 4 commits

[Model] Siglip Embedding Support (#27324) · 0552cfb1
Yu Jiaqi authored Oct 24, 2025
```
Signed-off-by: piood <2477084691@qq.com>
```
0552cfb1

[Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973) · 3fa2c121

wang.yuqi authored Oct 23, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>

3fa2c121

[Bugfix] Fix incorrect kv cache metrics in grafana.json (#27133) · 7e094105

fangpings authored Oct 22, 2025


Signed-off-by: Fangping Shi <fangping_shi@apple.com>
Co-authored-by: Fangping Shi <fangping_shi@apple.com>

7e094105

[Bugfix] Fix deepseek-ocr multi-image inference and add... · 2566dca2

Isotr0py authored Oct 23, 2025


[Bugfix] Fix deepseek-ocr multi-image inference and add `merge_by_field_config=True` with tensor schema support (#27361)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2566dca2

22 Oct, 2025 3 commits

[Model] Revert PR #26715: Restore custom PaliGemma and Gemma3-MM impl… (#27309) · e05a6754

Luciano Martins authored Oct 22, 2025


Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>

e05a6754

[Frontend] Require flag for loading text and image embeds (#27204) · 58fab50d

Russell Bryant authored Oct 22, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

58fab50d

[Model] Upstream Deepseek-OCR model (#27247) · 675aa2ec

Isotr0py authored Oct 22, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>

675aa2ec