Commits · 3aeb19a39e73cb44dd0a9402e66cbae97ea9f345 · OpenDAS / vllm_cscc

17 Oct, 2025 3 commits

[Model] Add support for LightOnOCR (#26916) · 3aeb19a3

Said Taghadouini authored Oct 17, 2025

Signed-off-by: Said Taghadouini <taghadouinisaid@gmail.com>
Signed-off-by: Said Taghadouini <84044788+staghado@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

3aeb19a3

[Model] Always use Transformers backend for PaliGemma and Gemma3-MM (#26715) · 8c017b34
Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
8c017b34
[Docs] Reduce custom syntax used in docs (#27009) · 4ffd6e89
Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
4ffd6e89

15 Oct, 2025 3 commits

[Model][2/N] Improve all pooling task | Support multi-vector retrieval (#25370) · f54f8512
wang.yuqi authored Oct 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
f54f8512
[Doc] ruff format remaining Python examples (#26795) · 62566979
Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
62566979

[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change ... · 96b9aa5a

Morrison Turnansky authored Oct 14, 2025


[Frontend][torch.compile] CompilationConfig Overhaul (#20283): name change  compilation level to compilation mode, deprecation compilation level (#26355)
Signed-off-by: morrison-turnansky <mturnans@redhat.com>
Signed-off-by: Morrison Turnansky <mturnans@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

96b9aa5a

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- Refactor MistralTokenizer (#26358) · c6187f55
  Julien Denize authored Oct 10, 2025
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  c6187f55
07 Oct, 2025 1 commit
- [Model] Use `merge_by_field_config` for MM models (Ovis family) (#26308) · 08d26a1b
  Isotr0py authored Oct 07, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  08d26a1b
06 Oct, 2025 2 commits
- [Model] Use `merge_by_field_config` for MM models (Llava family) (#26280) · 19a00eb2
  Cyrus Leung authored Oct 06, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  19a00eb2
- Fix per file ruff ignores related to line length (#26262) · 6c046382
  Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c046382
05 Oct, 2025 1 commit
- [Model] Use `merge_by_field_config` for MM models (H-L) (#26230) · 59a85c36
  Cyrus Leung authored Oct 05, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  59a85c36
04 Oct, 2025 1 commit
- [Model] CLIP Embedding Support (#26010) · 4570535e
  Cyrus Leung authored Oct 04, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4570535e
03 Oct, 2025 1 commit
- [Model] Use `merge_by_field_config` for MM models (InternVL family) (#26153) · f9a8084e
  Cyrus Leung authored Oct 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f9a8084e
30 Sep, 2025 2 commits
- [V1] [P/D] Add Support for KV Load Failure Recovery (#19330) · 9a9f48df
  David Ben-David authored Oct 01, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  9a9f48df
- [Doc] Improve MM Pooling model documentation (#25966) · 2f652e6c
  Cyrus Leung authored Oct 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2f652e6c
29 Sep, 2025 1 commit
- [Doc] Polish example for torchrun dp (#25899) · 8eb0a1d9
  Zhuohan Li authored Sep 29, 2025
  
  8eb0a1d9
26 Sep, 2025 2 commits
- [spec decode] Consolidate speculative decode method name for MTP (#25232) · c70ac4b8
  qizixi authored Sep 26, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
```
  c70ac4b8
- fix: print outputt offline_inference/base/chat.py example (#25744) · 6e30010d
  Iceber Gu authored Sep 26, 2025
```
Signed-off-by: Iceber Gu <caiwei95@hotmail.com>
```
  6e30010d
23 Sep, 2025 2 commits

[Spec Decode][CI] Add e2e test for `examples/spec_decode.py` and prevent... · 867ecdd1

Ekagra Ranjan authored Sep 23, 2025


[Spec Decode][CI] Add e2e test for `examples/spec_decode.py` and prevent breaking Acceptance Length (#24531)
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

867ecdd1

[XPU] Fix MOE DP accuracy issue on XPU (#25465) · 4c966e44
Fanli Lin authored Sep 23, 2025

4c966e44

22 Sep, 2025 2 commits

[DP] support torchrun external launcher with Data Parallelism (#24899) · 922979bf

Lucia Fang authored Sep 22, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

922979bf

[Model] Support Dots OCR (#24645) · 7b57a433

Roger Wang authored Sep 21, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: yinz-aizip <yinz@aizip.ai>

7b57a433

21 Sep, 2025 2 commits
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
- [V0 Deprecation] Remove LLMEngine (#25033) · 52c2a8d4
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  52c2a8d4
18 Sep, 2025 3 commits

[spec decode] Fix MTP inference path for MiMo-7B model (#25136) · c4cb0af9
qizixi authored Sep 18, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
c4cb0af9

[New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task (#24872) · 5f696c33

wang.yuqi authored Sep 18, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

5f696c33

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

17 Sep, 2025 2 commits

[V1] Logits processor docs (#22919) · 7ae98875

afeldman-nm authored Sep 17, 2025

Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
Co-authored-by: Joseph Marinier <Joseph.Marinier@gmail.com>

7ae98875

[Model] Support Qwen3-VL Model Series (#24727) · 0f7acdd7

Roger Wang authored Sep 16, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

0f7acdd7

16 Sep, 2025 2 commits

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) · 56793995

Sage Moore authored Sep 16, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

56793995

Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
759ef49b

15 Sep, 2025 2 commits
- [Bugfix] Fix GLM4.1V multimodal processor with compatability for Transformers v4.56 (#24822) · 0e219cd5
  Isotr0py authored Sep 15, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  0e219cd5
- [Misc] Fix examples openai_pooling_client.py (#24853) · bf214ca2
  wang.yuqi authored Sep 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bf214ca2
13 Sep, 2025 2 commits

[Doc]: fix typos in various files (#24798) · 41ae4a1e
Didier Durand authored Sep 13, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
41ae4a1e

[Frontend][Multimodal] Allow skipping media data when UUIDs are provided. (#23950) · 7f2ea707

Chenheli Hua authored Sep 12, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>

7f2ea707

10 Sep, 2025 1 commit
- [v1] Add Whisper model support (encoder-decoder) (#21088) · 37e8182b
  Russell Bryant authored Sep 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
  37e8182b
09 Sep, 2025 1 commit

[RL] fast weight update with zmq + ipc handles (#24295) · 3d2a2de8

Weixiao Huang authored Sep 09, 2025


Signed-off-by: huangweixiao <huangweixiao@msh.team>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

3d2a2de8

08 Sep, 2025 2 commits
- [Misc] Terratorch related fixes (#24337) · 9cd76b71
  Christian Pinto authored Sep 08, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  9cd76b71
- [Doc]: fix typos in Python comments (#24417) · f4962a6d
  Didier Durand authored Sep 08, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  f4962a6d