Commits · 2566dca2a9e4e24c941845905e0ebad62441a1fa · OpenDAS / vllm_cscc

23 Oct, 2025 1 commit

[Bugfix] Fix deepseek-ocr multi-image inference and add... · 2566dca2

Isotr0py authored Oct 23, 2025


[Bugfix] Fix deepseek-ocr multi-image inference and add `merge_by_field_config=True` with tensor schema support (#27361)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2566dca2

22 Oct, 2025 4 commits

[Model] Revert PR #26715: Restore custom PaliGemma and Gemma3-MM impl… (#27309) · e05a6754

Luciano Martins authored Oct 22, 2025


Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>

e05a6754

[Frontend] Require flag for loading text and image embeds (#27204) · 58fab50d

Russell Bryant authored Oct 22, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

58fab50d

[Model] Upstream Deepseek-OCR model (#27247) · 675aa2ec

Isotr0py authored Oct 22, 2025


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>

675aa2ec

[Frontend][3/N] Improve all pooling task | Support binary embedding response (#27066) · 1f633b86

wang.yuqi authored Oct 22, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1f633b86

20 Oct, 2025 1 commit

[Model][VLM] Support Bee-8B Model (#27012) · f32bf758

Yi Zhang authored Oct 20, 2025


Signed-off-by: uyzhang <yi.zhang.4096@gmail.com>
Signed-off-by: Yi Zhang <zhangyi970819@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

f32bf758

19 Oct, 2025 1 commit

[Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f

iAmir97 authored Oct 19, 2025


Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>

7a6c8c3f

17 Oct, 2025 3 commits

[Model] Add support for LightOnOCR (#26916) · 3aeb19a3

Said Taghadouini authored Oct 17, 2025

Signed-off-by: Said Taghadouini <taghadouinisaid@gmail.com>
Signed-off-by: Said Taghadouini <84044788+staghado@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

3aeb19a3

[Model] Always use Transformers backend for PaliGemma and Gemma3-MM (#26715) · 8c017b34
Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
8c017b34
[Docs] Reduce custom syntax used in docs (#27009) · 4ffd6e89
Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
4ffd6e89

15 Oct, 2025 3 commits

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
f54f8512
[Doc] ruff format remaining Python examples (#26795) · 62566979
Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
62566979

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

14 Oct, 2025 1 commit
- [Misc][DP] support customized aggregated logger for dp (#24354) · 8317f723
  Lucia Fang authored Oct 13, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  8317f723
13 Oct, 2025 3 commits

[Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64... · d2a79385

wang.yuqi authored Oct 14, 2025


[Frontend][1/N] Improve all pooling task | Support FP16 Embedding Base64 (Still uses fp32 by default). (#26414)
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Maximilien de Bayser <maxdebayser@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

d2a79385

[Model][0/N] Improve all pooling task | clean up (#25817) · 767c3ab8
wang.yuqi authored Oct 13, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
767c3ab8
docs: wrong command in structured_outputs README (#26677) · 3cd36660
yihong authored Oct 13, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
3cd36660

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
08 Oct, 2025 1 commit
- Remove Python 3.9 support ahead of PyTorch 2.9 in v0.11.1 (#26416) · e09d1753
  Harry Mellor authored Oct 08, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e09d1753
07 Oct, 2025 3 commits
- [Model] Use `merge_by_field_config` for MM models (Ovis family) (#26308) · 08d26a1b
  Isotr0py authored Oct 07, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  08d26a1b
- [V0 Deprecation] Remove `VLLM_USE_V1` from docs and scripts (#26336) · 7e4cd070
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7e4cd070
- [BugFix] Update KV block hash type from BlockHash to ExternalBlockHash in... · 46b07799
  Snehlata authored Oct 07, 2025
```
[BugFix] Update KV block hash type from BlockHash to ExternalBlockHash in kv_events_subscriber - #26264 (#26265)
Signed-off-by: atalhens <sneh.lata@nutanix.com>
```
  46b07799
06 Oct, 2025 2 commits
- [Model] Use `merge_by_field_config` for MM models (Llava family) (#26280) · 19a00eb2
  Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  19a00eb2
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 3 commits
- Remove all references to `yapf` as it's no longer used (#26251) · 4e256cad
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e256cad
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
- [Model] Use `merge_by_field_config` for MM models (H-L) (#26230) · 59a85c36
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  59a85c36
04 Oct, 2025 1 commit
- [Model] CLIP Embedding Support (#26010) · 4570535e
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4570535e
03 Oct, 2025 1 commit
- [Model] Use `merge_by_field_config` for MM models (InternVL family) (#26153) · f9a8084e
  Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f9a8084e
02 Oct, 2025 1 commit

[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm... · d00d6529

Cyrus Leung authored Oct 03, 2025


[CI/Build] Replace `vllm.entrypoints.openai.api_server` entrypoint with `vllm serve` command (#25967)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

d00d6529

30 Sep, 2025 2 commits
- [V1] [P/D] Add Support for KV Load Failure Recovery (#19330) · 9a9f48df
  David Ben-David authored Oct 01, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  9a9f48df
- [Doc] Improve MM Pooling model documentation (#25966) · 2f652e6c
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f652e6c
29 Sep, 2025 1 commit
- [Doc] Polish example for torchrun dp (#25899) · 8eb0a1d9
  Zhuohan Li authored Sep 29, 2025
  
  8eb0a1d9
27 Sep, 2025 1 commit

[Misc] Update openai client example file for multimodal (#25795) · 23b8ee67

Roger Wang authored Sep 27, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

23b8ee67

26 Sep, 2025 2 commits
- [spec decode] Consolidate speculative decode method name for MTP (#25232) · c70ac4b8
  qizixi authored Sep 26, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
```
  c70ac4b8
- fix: print outputt offline_inference/base/chat.py example (#25744) · 6e30010d
  Iceber Gu authored Sep 26, 2025
```
Signed-off-by: Iceber Gu <caiwei95@hotmail.com>
```
  6e30010d
24 Sep, 2025 1 commit
- [Docs] Enable `fail_on_warning` for the docs build in CI (#25580) · 8c853050
  Harry Mellor authored Sep 24, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8c853050
23 Sep, 2025 2 commits

[Spec Decode][CI] Add e2e test for `examples/spec_decode.py` and prevent... · 867ecdd1

Ekagra Ranjan authored Sep 23, 2025


[Spec Decode][CI] Add e2e test for `examples/spec_decode.py` and prevent breaking Acceptance Length (#24531)
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

867ecdd1

[XPU] Fix MOE DP accuracy issue on XPU (#25465) · 4c966e44
Fanli Lin authored Sep 23, 2025

4c966e44