Commits · d471b2aff09028f9c62e861f760a74fd8f99081d · OpenDAS / vllm_cscc

09 Dec, 2025 2 commits
- kv_transfer: Rename the shared storage connectors (#30201) · 4c6fd258
  Or Ozeri authored Dec 09, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  4c6fd258
- [Disagg] Support large batch size in proxy server and update NixlConnector doc for DP (#28782) · 60d17251
  Ming Yang authored Dec 08, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  60d17251
08 Dec, 2025 2 commits

[Frontend] Binary embedding response does not return metadata by setting... · 2e660c24

wang.yuqi authored Dec 08, 2025


[Frontend] Binary embedding response does not return metadata by setting encoding_format to bytes_only. (#30249)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

2e660c24

[Model][7/N] Improve all pooling task | Deprecation as_reward_model. Extract... · 9e77ffca

wang.yuqi authored Dec 08, 2025


[Model][7/N] Improve all pooling task | Deprecation as_reward_model. Extract hidden states prefer using new multi-vector retrieval API (#26686)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>

9e77ffca

05 Dec, 2025 2 commits
- [Misc] Rename CohereForAI references to CohereLabs (#30147) · 3633035a
  Russell Bryant authored Dec 05, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  3633035a
- [responsesAPI][5] ResponsesParser with tools for full MCP python loop (#29798) · da7bc54e
  Andrew Xia authored Dec 05, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Signed-off-by: Andrew Xia <axia@meta.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  da7bc54e
04 Dec, 2025 2 commits
- [Misc] Various cleanups for MM input processing (#29970) · 9ae2f603
  Cyrus Leung authored Dec 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9ae2f603
- fix LoRA-related examples (#29956) · 33a3d6c7
  Iceber Gu authored Dec 04, 2025
```
Signed-off-by: Iceber Gu <caiwei95@hotmail.com>
```
  33a3d6c7
03 Dec, 2025 2 commits
- SigLIP example add chat_template (#29902) · 9ae3c55b
  Yu Jiaqi authored Dec 04, 2025
```
Signed-off-by: piood <2477084691@qq.com>
```
  9ae3c55b
- [Bugfix] Fix incorrect `image_grid_thw` rank for HunyuanOCR from missing... · a21cd9ed
  Isotr0py authored Dec 03, 2025
```
[Bugfix] Fix incorrect `image_grid_thw` rank for HunyuanOCR from missing `merge_by_field_config=True` (#29950)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a21cd9ed
02 Dec, 2025 3 commits

Fix some more Transformers nightly tests (#29872) · 6fc5841d
Harry Mellor authored Dec 02, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
6fc5841d

[examples] Resettle pooling examples. (#29365) · 2eb4fe91

wang.yuqi authored Dec 02, 2025

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2eb4fe91

[Core] Support reseting all running requests' KV while calling `reset_prefix_cache` (#28827) · d0cd7289

Zhuohan Li authored Dec 01, 2025


Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

d0cd7289

01 Dec, 2025 1 commit
- [Frontend] Add tool filtering support to ToolServer (#29224) · 014ece97
  daniel-salib authored Dec 01, 2025
```
Signed-off-by: Daniel Salib <danielsalib@meta.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  014ece97
29 Nov, 2025 1 commit

[LoRA] Cleanup LoRA unused code (#29611) · 39e63dec

Jee Jee Li authored Nov 29, 2025


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39e63dec

25 Nov, 2025 3 commits

Attempt to fix GPU OOM in a spec-decoding test (#29419) · c32a18cb
Eldar Kurtić authored Nov 25, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
c32a18cb
Add TP CLI argument to multimodal inference examples (#29301) · a21256c4
Fanli Lin authored Nov 25, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
a21256c4

[Model] Add HunyuanOCR support (#29327) · 92effb07

Isotr0py authored Nov 25, 2025


Signed-off-by: manayang <jackmanayang@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: sergeywang <sergeywang@tencent.com>
Co-authored-by: manayang <jackmanayang@gmail.com>
Co-authored-by: manayang <manayang@tencent.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

92effb07

24 Nov, 2025 4 commits
- [Multimodal][Qwen3 Omni] Make Qwen3 Omni work with audio-in-video inputs in V1 engine. (#27721) · 839c6b7b
  Chenheli Hua authored Nov 24, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  839c6b7b
- [BugFix] Fix R-VL model loading error (#29299) · ed40d859
  Fanli Lin authored Nov 24, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  ed40d859
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
- [Bugfix] Update Gradio OpenAI Chatbot Webserver example to new Gradio message... · c309bb52
  Josh Moore authored Nov 23, 2025
```
[Bugfix] Update Gradio OpenAI Chatbot Webserver example to new Gradio message history format (#29249)
Signed-off-by: joshiemoore <joshiemoore98@gmail.com>
```
  c309bb52
23 Nov, 2025 1 commit
- [Doc] Update more docs with respect to V1 (#29188) · 389aa1b2
  Cyrus Leung authored Nov 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  389aa1b2
22 Nov, 2025 1 commit

[responsesAPI] parse reasoning item input (#28248) · 742e9ff6

Andrew Xia authored Nov 21, 2025


Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

742e9ff6

21 Nov, 2025 2 commits

[V0 deprecation] Remove more V0 references (#29088) · aab0102a
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
aab0102a

[Doc] cleanup TPU documentation and remove outdated examples (#29048) · dd39f91e

Rob Mulla authored Nov 20, 2025

Signed-off-by: Rob Mulla <rob.mulla@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

dd39f91e

20 Nov, 2025 1 commit
- [BugFix][PD]: make example proxy usable with P2pNcclConnector (#26628) · e5bfcb6a
  Pan Li authored Nov 21, 2025
```
Signed-off-by: PAN <1162953505@qq.com>
```
  e5bfcb6a
19 Nov, 2025 3 commits
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
- [Doc]: fix typos in various files (#28945) · 7ed27f3c
  Didier Durand authored Nov 19, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7ed27f3c
- Move online quantization to `model.load_weights` (#26327) · da94c7c0
  Jerry Zhang authored Nov 18, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  da94c7c0
18 Nov, 2025 1 commit

[chore] Move the rest of wikimedia url to S3 (#28921) · c64c0b78

Kevin H. Luu authored Nov 18, 2025


Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c64c0b78

14 Nov, 2025 2 commits

Remove audio optional dependency for mistral-common (#28722) · 08542480

Julien Denize authored Nov 14, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

08542480

[DisaggEverything] Tokens in<>out `/generate` endpoint (#24261) · 6f1e7f72

Nicolò Lucchesi authored Nov 14, 2025

Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6f1e7f72

13 Nov, 2025 2 commits
- [Bugfix] Fix FPS value type for Qwen2.5-Omni video processing (#28630) · c9fe6abe
  Fanli Lin authored Nov 13, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  c9fe6abe
- [Frontend] supports interleaved thinking (#28531) · 5c9ad138
  Chauncey authored Nov 13, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  5c9ad138
12 Nov, 2025 2 commits

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56

Chenguang Zheng authored Nov 12, 2025


Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>

4ccffe56

[[V0 deprecation]]Remove VLLM_USE_V1 env (#28204) · e1710393
wangxiyuan authored Nov 12, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
e1710393

09 Nov, 2025 2 commits
- [Misc] fix typo and add detailed log (#28178) · e5e9067e
  Ning Xie authored Nov 09, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  e5e9067e
- [chore] Move some wikimedia images to S3 (#28351) · 05f8d690
  Kevin H. Luu authored Nov 08, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  05f8d690
08 Nov, 2025 1 commit
- Enhance run_cluster.sh for multi-NIC support (#28328) · 77d702a2
  Ev Lacey authored Nov 08, 2025
```
Signed-off-by: Ev Lacey <elacey@nvidia.com>
```
  77d702a2