Commits · 4db44264047c2d30d9ba4eac55acaef821ae18b8 · OpenDAS / vllm_cscc

09 Sep, 2025 1 commit

[RL] fast weight update with zmq + ipc handles (#24295) · 3d2a2de8

Weixiao Huang authored Sep 09, 2025


Signed-off-by: huangweixiao <huangweixiao@msh.team>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

3d2a2de8

08 Sep, 2025 2 commits
- [Misc] Terratorch related fixes (#24337) · 9cd76b71
  Christian Pinto authored Sep 08, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  9cd76b71
- [Doc]: fix typos in Python comments (#24417) · f4962a6d
  Didier Durand authored Sep 08, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  f4962a6d
06 Sep, 2025 1 commit
- [V0 deprecation] Deprecate V0 Neuron backend (#21159) · 4172235a
  Woosuk Kwon authored Sep 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  4172235a
04 Sep, 2025 3 commits

[Doc]: fix typos in Python comments (#24173) · 83609ca9

Didier Durand authored Sep 04, 2025


Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

83609ca9

[Core][Model] Terratorch backend integration (#23513) · 51d5e9be

mgazz authored Sep 04, 2025


Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

51d5e9be

[Model] Add MiDashengLM model support (#23652) · e7fc7001

bingchen-mi authored Sep 04, 2025


Signed-off-by: chenbing8 <chenbing8@xiaomi.com>
Signed-off-by: bingchen-mi <chenbing8@xiaomi.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

e7fc7001

03 Sep, 2025 4 commits
- Remove deprecated `PyNcclConnector` (#24151) · b5ee1e32
  Peter Pan authored Sep 04, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  b5ee1e32
- [Kernels] Overlap shared experts with send/recv (#23273) · e9b92dcd
  bnellnm authored Sep 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e9b92dcd
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
- [V1] Wrapper which plumbs request-level logits processors into vLLM... · 136d853e
  afeldman-nm authored Sep 02, 2025
```
[V1] Wrapper which plumbs request-level logits processors into vLLM batch-level logits processing (#23656)
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
```
  136d853e
01 Sep, 2025 3 commits

[Model]: support KeyeVL-1_5-8B (#23838) · 7c8271cd

Kwai-Keye authored Sep 01, 2025


Signed-off-by: wangruitao <wangruitao@kuaishou.com>
Co-authored-by: wangruitao <wangruitao@kuaishou.com>

7c8271cd

[Doc]: fix typos in Python comments (#24026) · 10728495
Didier Durand authored Sep 01, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
10728495

[Misc] IO Processor plugins for pooling models (#22820) · 1cb39dbc

Christian Pinto authored Sep 01, 2025


Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Max de Bayser <mbayser@br.ibm.com>

1cb39dbc

28 Aug, 2025 1 commit
- [BugFix][Spec Decode] Use float64 for uniform_probs (#23803) · a3432f18
  Woosuk Kwon authored Aug 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  a3432f18
27 Aug, 2025 2 commits
- [LogitsProcs] Deduplicate built-in LP implementation logic (#23362) · 3ce8285d
  Nick Hill authored Aug 27, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  3ce8285d
- [Model] Add Ernie4.5 VL Model Support (#22514) · 644d57d5
  CSWYF3634076 authored Aug 27, 2025
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  644d57d5
24 Aug, 2025 1 commit
- [New Model]Donut model (#23229) · 416f0592
  汪志鹏 authored Aug 24, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  416f0592
22 Aug, 2025 1 commit
- [Deprecation] Remove `prompt_token_ids` arg fallback in `LLM.generate` and `LLM.embed` (#18800) · 8896eb72
  Cyrus Leung authored Aug 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8896eb72
21 Aug, 2025 2 commits

[Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
0c31e28e

[Model][VLM] Support R-4B Model (#23246) · 655a09f6

杨奇(yann qi) authored Aug 21, 2025

Signed-off-by: yannqi <yannqi@qq.com>
Signed-off-by: 杨奇(yann qi) <51905299+yannqi@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: yannqiyang <yannqiyang@tencent.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

655a09f6

19 Aug, 2025 3 commits

[Model] support new model ovis2.5 (#23084) · b87cb97a

myselvess authored Aug 19, 2025


Signed-off-by: myselvess <244285088@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

b87cb97a

[Bugfix] Fix broken Minimax-01-VL model (#22116) · 31fd3265

Isotr0py authored Aug 19, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

31fd3265

Fix GLM-4.5V-FP8 numerical issue (#22949) · 4efd43e9

qizixi authored Aug 19, 2025


Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

4efd43e9

16 Aug, 2025 3 commits

[V1] Logits processors extensibility (#19912) · bf7f470b

afeldman-nm authored Aug 16, 2025


Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Signed-off-by: Andrew Feldman <afeld2012@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

bf7f470b

[Kernel/Quant] Remove AQLM (#22943) · 4fc722ec

Michael Goin authored Aug 16, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

4fc722ec

[New Model]mBART model (#22883) · 829bbd78
汪志鹏 authored Aug 16, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
829bbd78

15 Aug, 2025 2 commits

[Kernels] Clean up FusedMoeMethodBase and modular kernel setup. Remove extra... · 8ad7285e

bnellnm authored Aug 15, 2025


[Kernels] Clean up FusedMoeMethodBase and modular kernel setup.  Remove extra arguments from modular kernel methods. (#22035)
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

8ad7285e

[Structured Output] Make the output of structured output example more complete (#22481) · 48b01fd4
Shanshan Shen authored Aug 16, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
48b01fd4

12 Aug, 2025 1 commit
- [New Model] Support Command-A-Vision (#22660) · 9f909b89
  dongluw authored Aug 12, 2025
```
Signed-off-by: donglu <donglu@cohere.com>
```
  9f909b89
09 Aug, 2025 1 commit

[Model] Gemma3n MM (#20495) · 5a16fa61

Nicolò Lucchesi authored Aug 09, 2025


Signed-off-by: ShriKode <shrikode@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: ShriKode <shrikode@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>

5a16fa61

07 Aug, 2025 2 commits
- [Frontend] Use engine argument to control MM cache size (#22441) · 139d1557
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  139d1557
- [Core] Store only the keys for multi-modal data in P0 (#22198) · 766bc816
  Cyrus Leung authored Aug 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  766bc816
04 Aug, 2025 2 commits
- [Misc] Modify the organization of GLM series (#22171) · a7b8788d
  Jee Jee Li authored Aug 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a7b8788d
- [RLHF] Fix torch.dtype not serializable in example (#22158) · 845420ac
  22quinn authored Aug 03, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  845420ac
01 Aug, 2025 2 commits
- [Doc] Add example for Step3-VL (#22061) · 27a145e8
  Roger Wang authored Aug 01, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  27a145e8
- [Misc] Automatically resolve HF processor init kwargs (#22005) · 82de9b9d
  Cyrus Leung authored Aug 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82de9b9d
31 Jul, 2025 2 commits
- [Meta] Official Eagle mm support, first enablement on llama4 (#20788) · 9e0726e5
  zhiweiz authored Jul 31, 2025
```
Signed-off-by: morgendave <morgendave@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  9e0726e5
- [Example] Add `async_llm_streaming.py` example for AsyncLLM streaming in python (#21763) · 9cb497bf
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  9cb497bf
30 Jul, 2025 1 commit
- [Frontend] Add LLM.reward specific to reward models (#21720) · 65f311ce
  wang.yuqi authored Jul 30, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  65f311ce