Commits · 17edd8a807019c8d1e58634aecb1de7984e8d467 · OpenDAS / vllm_cscc

03 Oct, 2025 1 commit

[Multi Modal] Configurable MM Profiling (#25631) · 79aa2446

Wenlong Wang authored Oct 03, 2025

Signed-off-by: wwl2755 <wangwenlong2755@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

79aa2446

29 Sep, 2025 1 commit
- [V0 Deprecation][Models] Remove all V0 condition for mm embeddings merge (#25331) · bd51f78e
  Isotr0py authored Sep 29, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  bd51f78e
27 Sep, 2025 1 commit

[Bugfix] Merge MM embeddings by index instead of token IDs (#16229) · 27d7638b

Cyrus Leung authored Sep 27, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

27d7638b

21 Sep, 2025 1 commit
- [V0 Deprecation] Remove V0 sampling metadata (#25345) · 1c3ffdbe
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
```
  1c3ffdbe
12 Sep, 2025 1 commit
- [Doc]: fix typos in various files (#24726) · bcb06d7b
  Didier Durand authored Sep 12, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  bcb06d7b
30 Aug, 2025 1 commit

[Model] Enable encoder DP for MiniCPM-V (#23948) · 3a6acad4

Jiangyun Zhu authored Aug 30, 2025


Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

3a6acad4

27 Aug, 2025 3 commits

[Model] Interface to enable batch-level DP support (#23733) · fe8d7b6f

Cyrus Leung authored Aug 27, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

fe8d7b6f

[model] Support MiniCPM-V 4.5 (#23586) · 9d30de44

tc-mb authored Aug 27, 2025


Signed-off-by: tc-mb <caitianchi@modelbest.cn>
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Abatom <abzhonghua@gmail.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Pate Motter <patemotter@google.com>
Signed-off-by: Terrencezzj <terrence@cohere.ai>
Signed-off-by: Woosuk Kwon <woosuk@thinkingmachines.ai>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Signed-off-by: siyuanf <siyuanf@nvidia.com>
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
Signed-off-by: Zijing Liu <liuzijing2014@users.noreply.github.com>
Signed-off-by: jiabin.00 <jiabin.00@bytedance.com>
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: tc-mb <157115220+tc-mb@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Huy Do <huydhn@gmail.com>
Signed-off-by: Matúš Námešný <matus.namesny@ameria.com>
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: oye93 <en.ouyang93@outlook.com>
Signed-off-by: Julien Lin <jullin@nvidia.com>
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Tianyu Li <tianyu.li@arm.com>
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Signed-off-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Huzaifa Sidhpurwala <huzaifas@redhat.com>
Signed-off-by: Federico <65908512+coval3nte@users.noreply.github.com>
Signed-off-by: Zixuan Zhang <zixuanzhang@bytedance.com>
Signed-off-by: wuhang <wuhang6@huawei.com>
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
Signed-off-by: Wei Wei <wwei6@meta.com>
Signed-off-by: Yiheng Xu <charlesyihengxu@gmail.com>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
Co-authored-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Zhonghua Deng <abzhonghua@gmail.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Pate Motter <p@temotter.com>
Co-authored-by: Terrence Zhao <32208165+Terrencezzj@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: weiliang <weiliangl@nvidia.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Zijing Liu <liuzijing2014@users.noreply.github.com>
Co-authored-by: Bin Jia <45593998+FoolPlayer@users.noreply.github.com>
Co-authored-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Raghavan <oneraghavan@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.me>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: Huy Do <huydhn@gmail.com>
Co-authored-by: Matúš Námešný <matus@namesny.com>
Co-authored-by: Guillaume Calmettes <gcalmettes@scaleway.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: En Ouyang <en.ouyang93@outlook.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
Co-authored-by: nvjullin <jullin@nvidia.com>
Co-authored-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: TianyuLi0 <116711075+TianyuLi0@users.noreply.github.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Hyogeun Oh (오효근) <ohg3417@gmail.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Lukas Geiger <lukas.geiger94@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Huzaifa Sidhpurwala <huzaifas@redhat.com>
Co-authored-by: Federico <65908512+coval3nte@users.noreply.github.com>
Co-authored-by: zixuanzhang226 <zixuanzhang@bytedance.com>
Co-authored-by: wuhang <wuhang6@huawei.com>
Co-authored-by: yzds <41983536+youzhedian@users.noreply.github.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: czhu-cohere <conway.zhu@cohere.com>
Co-authored-by: Wei <weiweinpu@gmail.com>
Co-authored-by: Yiheng Xu <charlesyihengxu@gmail.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: CSWYF3634076 <58356743+CSWYF3634076@users.noreply.github.com>

9d30de44

[Core] Use key-only cache for `BaseMultiModalProcessor` (#23018) · 69244e67
Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
69244e67

23 Aug, 2025 1 commit
- [Model] Support DP for ViT on MiniCPM-V-4 (#23327) · 23c939fd
  WeiQing Chen authored Aug 23, 2025
```
Signed-off-by: ycyaw66 <497410282@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>
```
  23c939fd
18 Aug, 2025 1 commit
- [Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053) · 27e8d1ea
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27e8d1ea
13 Aug, 2025 2 commits

[CI/Build] Update VLM common tests (#22841) · c9232d41
Cyrus Leung authored Aug 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
c9232d41

[Bugfix] Fix MiniCPMV Image input inference failed (#22813) · 9bd9294f

HWH authored Aug 14, 2025


Signed-off-by: HWH <67449739+jio-H@users.noreply.github.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9bd9294f

12 Aug, 2025 1 commit
- Migrate MiniCPMVImageInputs to TensorSchema (#21939) · 46785034
  Benji Beck authored Aug 11, 2025
```
Signed-off-by: Benji Beck <benjibeck@meta.com>
```
  46785034
07 Aug, 2025 1 commit
- [model] Support MiniCPM-V 4.0 (#22166) · 41b67f42
  tc-mb authored Aug 07, 2025
```
Co-authored-by: imning3 <hbning@pku.edu.cn>
```
  41b67f42
01 Aug, 2025 1 commit
- [Misc] Automatically resolve HF processor init kwargs (#22005) · 82de9b9d
  Cyrus Leung authored Aug 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  82de9b9d
03 Jul, 2025 1 commit
- [Core] Move multimodal placeholder from chat utils to model definition (#20355) · b024a42e
  Cyrus Leung authored Jul 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b024a42e
30 Jun, 2025 1 commit
- [Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (#20058) · d8cf819a
  Kyle Sayers authored Jun 30, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d8cf819a
18 Jun, 2025 1 commit
- [Core] More fixes to MultiModalEmbeddings type handling (#19715) · 14fdd21d
  Russell Bryant authored Jun 18, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  14fdd21d
16 Jun, 2025 1 commit
- [V1] Change return type on get_multimodal_embeddings() (#19446) · 90f9c2eb
  Russell Bryant authored Jun 16, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  90f9c2eb
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
15 May, 2025 1 commit
- Update deprecated type hinting in `models` (#18132) · 26d04193
  Harry Mellor authored May 15, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  26d04193
29 Apr, 2025 1 commit
- [Bugfix] Fix Minicpm-O-int4 GPTQ model inference (#17397) · 2fa2a50b
  Isotr0py authored Apr 30, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  2fa2a50b
24 Apr, 2025 1 commit
- [Chore] Remove Sampler from Model Code (#17084) · b411418f
  Woosuk Kwon authored Apr 24, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  b411418f
12 Apr, 2025 1 commit
- [V1] Enable multi-input by default (#15799) · d9fc8cd9
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9fc8cd9
10 Apr, 2025 2 commits
- [VLM] Avoid unnecessary dummy multimodal data during processing (#16416) · 56d4aefa
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56d4aefa
- [VLM] Remove `BaseProcessingInfo.get_mm_max_tokens_per_item` (#16408) · 83b824c8
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83b824c8
09 Apr, 2025 1 commit
- [Model] Add `SupportsMultiModal.get_language_model` interface (#16007) · d55244df
  Nicolò Lucchesi authored Apr 09, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  d55244df
08 Apr, 2025 1 commit

[V1] Scatter and gather placeholders in the model runner (#16076) · f2ebb6f5

Roger Wang authored Apr 07, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>

f2ebb6f5

04 Apr, 2025 2 commits

Revert "[V1] Scatter and gather placeholders in the model runner" (#16075) · af51d80f
Roger Wang authored Apr 04, 2025

af51d80f

[V1] Scatter and gather placeholders in the model runner (#15712) · f5722a50

Cyrus Leung authored Apr 05, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

f5722a50

31 Mar, 2025 1 commit
- [Bugfix] Check dimensions of multimodal embeddings in V1 (#15816) · 09e974d4
  Cyrus Leung authored Apr 01, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  09e974d4
30 Mar, 2025 1 commit
- [V1] Override `mm_counts` for dummy data creation (#15703) · 803d5c35
  Cyrus Leung authored Mar 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  803d5c35
27 Mar, 2025 1 commit
- [Model] MiniCPM-V/O supports V1 (#15487) · ac5bc615
  Cyrus Leung authored Mar 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ac5bc615
25 Mar, 2025 1 commit
- [Misc] Clean up MiniCPM-V/O code (#15337) · a9e879b3
  Cyrus Leung authored Mar 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a9e879b3
14 Mar, 2025 1 commit
- [VLM] Various cleanup and fixes (#14806) · ab93f136
  Cyrus Leung authored Mar 14, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ab93f136
07 Mar, 2025 1 commit
- [Bugfix] Clean up multi-modal processors (#14417) · 05fb6718
  Cyrus Leung authored Mar 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  05fb6718
05 Mar, 2025 1 commit
- [Misc][V1] Avoid using `envs.VLLM_USE_V1` in mm processing (#14256) · ec79b67c
  Roger Wang authored Mar 04, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  ec79b67c
28 Feb, 2025 1 commit
- [V1]`SupportsV0Only` protocol for model definitions (#13959) · 6c85da3a
  Roger Wang authored Feb 27, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  6c85da3a
27 Feb, 2025 1 commit
- [VLM] Generalized prompt updates for multi-modal processor (#13964) · f1579b22
  Cyrus Leung authored Feb 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f1579b22