Commits · a0e0efd6bdcfd071e5f4123319628887dfd4973d · OpenDAS / vllm_cscc

01 Sep, 2025 1 commit

[Model] Support DP for ViT on Kimi-VL-A3B-Thinking-2506 (#23817) · a0e0efd6

WeiQing Chen authored Sep 02, 2025


Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

a0e0efd6

31 Aug, 2025 1 commit
- [Core][Multimodal] Allow passing `multi_modal_uuids` as multimodal identifiers. (#23394) · 749be00a
  Roger Wang authored Aug 30, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  749be00a
29 Aug, 2025 3 commits
- Adds `json_count_leaves` utility function (#23899) · 4f7cde72
  Adit Chawdhary authored Aug 29, 2025
```
Signed-off-by: aditchawdhary <aditxy@hotmail.com>
```
  4f7cde72
- [Multimodal] Consolidate mm inputs into MultiModalFeatureSpec (#23779) · 69f46359
  Flora Feng authored Aug 29, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  69f46359
- [V0 Deprecation] Remove pooling model support in V0 (#23434) · 2554b27b
  Maximilien de Bayser authored Aug 29, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2554b27b
27 Aug, 2025 2 commits
- [Multimodal] Generate mm_hash based on request metadata when caching is turned off (#23690) · 8bf6266a
  Roger Wang authored Aug 27, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  8bf6266a
- [Core] Use key-only cache for `BaseMultiModalProcessor` (#23018) · 69244e67
  Cyrus Leung authored Aug 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  69244e67
26 Aug, 2025 3 commits

[Bugfix] Fix incorrect original shape in hashing (#23672) · 9715f7bb

Cyrus Leung authored Aug 27, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Lukas Geiger <lukas.geiger94@gmail.com>

9715f7bb

[v1] Add cross-attention KV cache support for encoder-decoder models (#23664) · 98aa16ff
Russell Bryant authored Aug 26, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
98aa16ff

[Bugfix] fix bf16 multimodal model hash (#23623) · 513298f1

Yuekai Zhang authored Aug 26, 2025

Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

513298f1

25 Aug, 2025 2 commits
- [Refactor] Pass `tokenizer` explicitly instead of binding to prompt update (#23542) · 6879cd80
  Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6879cd80
- [Refactor] Dynamic `target` and `content` for prompt updates (#23411) · 712d0f88
  Cyrus Leung authored Aug 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  712d0f88
24 Aug, 2025 1 commit
- [New Model]Donut model (#23229) · 416f0592
  汪志鹏 authored Aug 24, 2025
```
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
```
  416f0592
23 Aug, 2025 1 commit
- [Model] Support DP for ViT on MiniCPM-V-4 (#23327) · 23c939fd
  WeiQing Chen authored Aug 23, 2025
```
Signed-off-by: ycyaw66 <497410282@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>
```
  23c939fd
21 Aug, 2025 1 commit

[Multimodal] Always enable hashing mm data (#23308) · 79f05e44

Roger Wang authored Aug 21, 2025


Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

79f05e44

19 Aug, 2025 1 commit

[FEAT] [Performance] Enable DP for ViT in Qwen2.5VL (#22742) · 1298c677

TJian authored Aug 19, 2025


Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1298c677

18 Aug, 2025 3 commits
- [Refactor] Get prompt updates earlier (#23097) · d3f71f12
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d3f71f12
- [Refactor] Define MultiModalKwargsItems separate from MultiModalKwargs (#23053) · 27e8d1ea
  Cyrus Leung authored Aug 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27e8d1ea
- [Misc] Fix backward compatibility from #23030 (#23070) · 89657a55
  Roger Wang authored Aug 17, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  89657a55
17 Aug, 2025 1 commit
- [Refactor] Defer tensor data construction in MultiModalKwargs (#23030) · 5c32143b
  Cyrus Leung authored Aug 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5c32143b
16 Aug, 2025 1 commit
- [Refactor] Allow optional MultiModalKwargsItem in IPC (#23022) · 4dff91c9
  Cyrus Leung authored Aug 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4dff91c9
15 Aug, 2025 2 commits
- Improve multimodal hasher performance for re-used Image prompts (#22825) · 22341b99
  Staszek Paśko authored Aug 15, 2025
```
Signed-off-by: Staszek Pasko <staszek@gmail.com>
```
  22341b99
- [Bugfix] Unquote file uri before reading image (#22912) · aa300c43
  Sayandip Dutta authored Aug 15, 2025
```
Signed-off-by: Sayandip Dutta <sayandip199309@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  aa300c43
13 Aug, 2025 2 commits
- [Core] Use individual MM items in P0/P1 cache and model runner (#22570) · 19b927e5
  Cyrus Leung authored Aug 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  19b927e5
- [Frontend] Multithreaded async multimodal load_bytes (#22710) · 20d65aa7
  milesial authored Aug 13, 2025
```
Signed-off-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
Co-authored-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
```
  20d65aa7
11 Aug, 2025 1 commit
- [Misc] Move jsontree to utils (#22622) · 951b0382
  Cyrus Leung authored Aug 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  951b0382
09 Aug, 2025 2 commits

[Bugfix] Fix basic models tests hanging due to mm processor creation (#22571) · fbd8595c
Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
fbd8595c

Implicit language-model-only mode via limit-mm-per-prompt (#22299) · 08b751ba

Roger Wang authored Aug 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Andy Xie <andy.xning@gmail.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: XIn Li <xinli@nvidia.com>
Signed-off-by: Junhao Li <junhao@ubicloud.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
Signed-off-by: zitian zhao <zitian.zhao@tencentmusic.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Signed-off-by: Linkun <github@lkchen.net>
Co-authored-by: Ning Xie <andy.xning@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Zhiyu <zhiyuc@nvidia.com>
Co-authored-by: Shu Wang <shuw@nvidia.com>
Co-authored-by: XIn Li <xinli@nvidia.com>
Co-authored-by: Junhao Li <streaver91@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Yuxuan Zhang <2448370773@qq.com>
Co-authored-by: ZiTian Zhao <zitian.zhao@tencentmusic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Hong Hanh <hanh.usth@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: lkchen <github@lkchen.net>

08b751ba

08 Aug, 2025 1 commit
- [CI/Build] Fix multimodal tests (#22491) · 1712543d
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1712543d
07 Aug, 2025 3 commits
- [Frontend] Use engine argument to control MM cache size (#22441) · 139d1557
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  139d1557
- [Core] Simplify mm processing cache (#22457) · 8c9da6be
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8c9da6be
- [Core] Store only the keys for multi-modal data in P0 (#22198) · 766bc816
  Cyrus Leung authored Aug 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  766bc816
02 Aug, 2025 1 commit
- [Frontend] Improve error message for too many mm items (#22114) · f5d0f478
  Cyrus Leung authored Aug 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f5d0f478
01 Aug, 2025 1 commit
- feat(multimodal): Add customizable background color for RGBA to RGB conversion (#22052) · 0a6d305e
  Gamhang authored Aug 01, 2025
```
Signed-off-by: Jinheng Li <ahengljh@gmail.com>
Co-authored-by: Jinheng Li <ahengljh@gmail.com>
```
  0a6d305e
31 Jul, 2025 1 commit
- [Deprecation] Remove deprecated args and methods (#21907) · 9532a6d5
  Cyrus Leung authored Jul 31, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9532a6d5
30 Jul, 2025 1 commit

[Bugfix] Correct max tokens for non-contiguous embeds (#21798) · 0e36abf9

milesial authored Jul 29, 2025


Signed-off-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
Co-authored-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>

0e36abf9

23 Jul, 2025 2 commits
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- Fixed typo in profiling logs (#21441) · 6364af92
  Sergio Paniego Blanco authored Jul 23, 2025
  
  6364af92
08 Jul, 2025 1 commit
- [Core] Rename `get_max_tokens_per_item` for backward compatibility (#20630) · 32dffc27
  Cyrus Leung authored Jul 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32dffc27
05 Jul, 2025 1 commit
- [Misc] Remove the unused LoRA test code (#20494) · 906e05d8
  Jee Jee Li authored Jul 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  906e05d8