Commits · da5e7e432979254eb0d8a528c40ae73e121cca20 · OpenDAS / vllm_cscc

22 Sep, 2025 2 commits

[DP] support torchrun external launcher with Data Parallelism (#24899) · 922979bf

Lucia Fang authored Sep 22, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

922979bf

[Model] Support Dots OCR (#24645) · 7b57a433

Roger Wang authored Sep 21, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: yinz-aizip <yinz@aizip.ai>

7b57a433

21 Sep, 2025 2 commits
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
- [V0 Deprecation] Remove LLMEngine (#25033) · 52c2a8d4
  Woosuk Kwon authored Sep 20, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  52c2a8d4
18 Sep, 2025 3 commits

[spec decode] Fix MTP inference path for MiMo-7B model (#25136) · c4cb0af9
qizixi authored Sep 18, 2025
```
Signed-off-by: zixi-qi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
c4cb0af9

[New Model] Support BertForTokenClassification / Named Entity Recognition (NER) task (#24872) · 5f696c33

wang.yuqi authored Sep 18, 2025


Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

5f696c33

[Chore] Cleanup guided namespace, move to structured outputs config (#22772) · 29283e89

Aaron Pham authored Sep 18, 2025

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

29283e89

17 Sep, 2025 2 commits

[V1] Logits processor docs (#22919) · 7ae98875

afeldman-nm authored Sep 17, 2025

Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
Co-authored-by: Joseph Marinier <Joseph.Marinier@gmail.com>

7ae98875

[Model] Support Qwen3-VL Model Series (#24727) · 0f7acdd7

Roger Wang authored Sep 16, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huang Jie <92386084+JJJYmmm@users.noreply.github.com>
Co-authored-by: 松灵 <26085463+wulipc@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

0f7acdd7

16 Sep, 2025 2 commits

[Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM (#23693) · 56793995

Sage Moore authored Sep 16, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

56793995

Remove V0 Encoder-Decoder Support (#24907) · 759ef49b
Woosuk Kwon authored Sep 15, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
759ef49b

15 Sep, 2025 2 commits
- [Bugfix] Fix GLM4.1V multimodal processor with compatability for Transformers v4.56 (#24822) · 0e219cd5
  Isotr0py authored Sep 15, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  0e219cd5
- [Misc] Fix examples openai_pooling_client.py (#24853) · bf214ca2
  wang.yuqi authored Sep 15, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bf214ca2
13 Sep, 2025 2 commits

[Doc]: fix typos in various files (#24798) · 41ae4a1e
Didier Durand authored Sep 13, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
41ae4a1e

[Frontend][Multimodal] Allow skipping media data when UUIDs are provided. (#23950) · 7f2ea707

Chenheli Hua authored Sep 12, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>

7f2ea707

10 Sep, 2025 1 commit
- [v1] Add Whisper model support (encoder-decoder) (#21088) · 37e8182b
  Russell Bryant authored Sep 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
```
  37e8182b
09 Sep, 2025 1 commit

[RL] fast weight update with zmq + ipc handles (#24295) · 3d2a2de8

Weixiao Huang authored Sep 09, 2025


Signed-off-by: huangweixiao <huangweixiao@msh.team>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

3d2a2de8

08 Sep, 2025 2 commits
- [Misc] Terratorch related fixes (#24337) · 9cd76b71
  Christian Pinto authored Sep 08, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  9cd76b71
- [Doc]: fix typos in Python comments (#24417) · f4962a6d
  Didier Durand authored Sep 08, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  f4962a6d
06 Sep, 2025 1 commit
- [V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
  Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4172235a
04 Sep, 2025 3 commits

[Doc]: fix typos in Python comments (#24173) · 83609ca9

Didier Durand authored Sep 04, 2025


Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

83609ca9

[Core][Model] Terratorch backend integration (#23513) · 51d5e9be

mgazz authored Sep 04, 2025


Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

51d5e9be

[Model] Add MiDashengLM model support (#23652) · e7fc7001

bingchen-mi authored Sep 04, 2025


Signed-off-by: chenbing8 <chenbing8@xiaomi.com>
Signed-off-by: bingchen-mi <chenbing8@xiaomi.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

e7fc7001

03 Sep, 2025 4 commits
- Remove deprecated `PyNcclConnector` (#24151) · b5ee1e32
  Peter Pan authored Sep 04, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  b5ee1e32
- [Kernels] Overlap shared experts with send/recv (#23273) · e9b92dcd
  bnellnm authored Sep 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e9b92dcd
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
- [V1] Wrapper which plumbs request-level logits processors into vLLM... · 136d853e
  afeldman-nm authored Sep 02, 2025
```
[V1] Wrapper which plumbs request-level logits processors into vLLM batch-level logits processing (#23656)
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  136d853e
01 Sep, 2025 3 commits

[Model]: support KeyeVL-1_5-8B (#23838) · 7c8271cd

Kwai-Keye authored Sep 01, 2025


Signed-off-by: wangruitao <wangruitao@kuaishou.com>
Co-authored-by: wangruitao <wangruitao@kuaishou.com>

7c8271cd

[Doc]: fix typos in Python comments (#24026) · 10728495
Didier Durand authored Sep 01, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
10728495

[Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc

Christian Pinto authored Sep 01, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1cb39dbc

28 Aug, 2025 1 commit
- [BugFix][Spec Decode] Use float64 for uniform_probs (#23803) · a3432f18
  Woosuk Kwon authored Aug 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  a3432f18
27 Aug, 2025 2 commits
- [LogitsProcs] Deduplicate built-in LP implementation logic (#23362) · 3ce8285d
  Nick Hill authored Aug 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  3ce8285d
- [Model] Add Ernie4.5 VL Model Support (#22514) · 644d57d5
  CSWYF3634076 authored Aug 27, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  644d57d5
24 Aug, 2025 1 commit
- [New Model]Donut model (#23229) · 416f0592
  汪志鹏 authored Aug 24, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  416f0592
22 Aug, 2025 1 commit
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
21 Aug, 2025 2 commits

[Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
0c31e28e

[Model][VLM] Support R-4B Model (#23246) · 655a09f6

杨奇(yann qi) authored Aug 21, 2025

Signed-off-by: yannqi <yannqi@qq.com>
Signed-off-by: 杨奇(yann qi) <51905299+yannqi@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: yannqiyang <yannqiyang@tencent.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

655a09f6

19 Aug, 2025 3 commits

[Model] support new model ovis2.5 (#23084) · b87cb97a

myselvess authored Aug 19, 2025


Signed-off-by: myselvess <244285088@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

b87cb97a

[Bugfix] Fix broken Minimax-01-VL model (#22116) · 31fd3265

Isotr0py authored Aug 19, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

31fd3265

Fix GLM-4.5V-FP8 numerical issue (#22949) · 4efd43e9

qizixi authored Aug 19, 2025


Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4efd43e9