Commits · 20d65aa75548c4ee0c9b69847f177dec085cd358 · OpenDAS / vllm_cscc

13 Aug, 2025 1 commit

[Frontend] Multithreaded async multimodal load_bytes (#22710) · 20d65aa7

milesial authored Aug 13, 2025


Signed-off-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
Co-authored-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>

20d65aa7

11 Aug, 2025 1 commit
- [Misc] Move jsontree to utils (#22622) · 951b0382
  Cyrus Leung authored Aug 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  951b0382
09 Aug, 2025 2 commits

[Bugfix] Fix basic models tests hanging due to mm processor creation (#22571) · fbd8595c
Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
fbd8595c

Implicit language-model-only mode via limit-mm-per-prompt (#22299) · 08b751ba

Roger Wang authored Aug 08, 2025


Signed-off-by: Roger Wang <hey@rogerw.me>
Signed-off-by: Andy Xie <andy.xning@gmail.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Signed-off-by: Andrew Sansom <andrew@protopia.ai>
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: XIn Li <xinli@nvidia.com>
Signed-off-by: Junhao Li <junhao@ubicloud.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
Signed-off-by: zitian zhao <zitian.zhao@tencentmusic.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Signed-off-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Signed-off-by: Linkun <github@lkchen.net>
Co-authored-by: Ning Xie <andy.xning@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
Co-authored-by: Andrew Sansom <andrew@protopia.ai>
Co-authored-by: Zhiyu <zhiyuc@nvidia.com>
Co-authored-by: Shu Wang <shuw@nvidia.com>
Co-authored-by: XIn Li <xinli@nvidia.com>
Co-authored-by: Junhao Li <streaver91@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
Co-authored-by: Yuxuan Zhang <2448370773@qq.com>
Co-authored-by: ZiTian Zhao <zitian.zhao@tencentmusic.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: iAmir97 <71513472+iAmir97@users.noreply.github.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Hong Hanh <hanh.usth@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: lkchen <github@lkchen.net>

08b751ba

08 Aug, 2025 1 commit
- [CI/Build] Fix multimodal tests (#22491) · 1712543d
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1712543d
07 Aug, 2025 3 commits
- [Frontend] Use engine argument to control MM cache size (#22441) · 139d1557
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  139d1557
- [Core] Simplify mm processing cache (#22457) · 8c9da6be
  Cyrus Leung authored Aug 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8c9da6be
- [Core] Store only the keys for multi-modal data in P0 (#22198) · 766bc816
  Cyrus Leung authored Aug 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  766bc816
02 Aug, 2025 1 commit
- [Frontend] Improve error message for too many mm items (#22114) · f5d0f478
  Cyrus Leung authored Aug 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f5d0f478
01 Aug, 2025 1 commit
- feat(multimodal): Add customizable background color for RGBA to RGB conversion (#22052) · 0a6d305e
  Gamhang authored Aug 01, 2025
```
Signed-off-by: Jinheng Li <ahengljh@gmail.com>
Co-authored-by: Jinheng Li <ahengljh@gmail.com>
```
  0a6d305e
31 Jul, 2025 1 commit
- [Deprecation] Remove deprecated args and methods (#21907) · 9532a6d5
  Cyrus Leung authored Jul 31, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9532a6d5
30 Jul, 2025 1 commit

[Bugfix] Correct max tokens for non-contiguous embeds (#21798) · 0e36abf9

milesial authored Jul 29, 2025


Signed-off-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>
Co-authored-by: Alexandre Milesi <30204471+milesial@users.noreply.github.com>

0e36abf9

23 Jul, 2025 2 commits
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- Fixed typo in profiling logs (#21441) · 6364af92
  Sergio Paniego Blanco authored Jul 23, 2025
  
  6364af92
08 Jul, 2025 1 commit
- [Core] Rename `get_max_tokens_per_item` for backward compatibility (#20630) · 32dffc27
  Cyrus Leung authored Jul 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  32dffc27
05 Jul, 2025 1 commit
- [Misc] Remove the unused LoRA test code (#20494) · 906e05d8
  Jee Jee Li authored Jul 05, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  906e05d8
04 Jul, 2025 2 commits
- [CI Bugfix] Fix pre-commit failures on main (#20502) · c108781c
  Michael Goin authored Jul 05, 2025
  
  c108781c
- [Misc] Small: Remove global media connector. Each test should have its own... · ffe00ef7
  Chenheli Hua authored Jul 04, 2025
```
[Misc] Small: Remove global media connector. Each test should have its own test connector object. (#20395)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  ffe00ef7
03 Jul, 2025 1 commit
- [Misc] Small: Fix video loader return type annotations. (#20389) · b616f6a5
  Chenheli Hua authored Jul 02, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  b616f6a5
02 Jul, 2025 1 commit

[Frontend] Support configurable mm placeholder strings & flexible video... · 2e7cbf2d

Chenheli Hua authored Jul 01, 2025


[Frontend] Support configurable mm placeholder strings & flexible video sampling policies via CLI flags. (#20105)
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>

2e7cbf2d

01 Jul, 2025 1 commit

Add GLM4.1V model (Draft) (#19331) · ed70f3c6

Yuxuan Zhang authored Jul 01, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

ed70f3c6

30 Jun, 2025 1 commit
- [Core] [Bugfix] [Multimodal] Fix multimodal profiling and generation for SFT/PTQed models (#20058) · d8cf819a
  Kyle Sayers authored Jun 30, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  d8cf819a
25 Jun, 2025 1 commit
- Move to a faster base64 implementation (#19984) · 3443aaf8
  h-avsha authored Jun 25, 2025
```
Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>
```
  3443aaf8
21 Jun, 2025 1 commit

[Multimodal] Optimize Qwen2/2.5-VL startup time (#19756) · 2c5302fa

Woosuk Kwon authored Jun 21, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: Roger Wang <hey@rogerw.me>

2c5302fa

18 Jun, 2025 1 commit
- [Core] Do not copy array during hashing (#19484) · 3b523e38
  Lukas Geiger authored Jun 18, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  3b523e38
12 Jun, 2025 1 commit
- [CI] change spell checker from codespell to typos (#18711) · 2f1c19b2
  Ning Xie authored Jun 12, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2f1c19b2
11 Jun, 2025 1 commit
- [Misc] Remove unused `MultiModalHasher.hash_prompt_mm_data` (#19422) · 96ada386
  Lukas Geiger authored Jun 11, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  96ada386
10 Jun, 2025 1 commit
- [Core] Batch multi modal input using pinned memory (#19169) · 319cb1e3
  Lukas Geiger authored Jun 10, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  319cb1e3
05 Jun, 2025 1 commit

[Bugfix] properly catch PIL-related errors for vision models when incorrect... · 9bc8bb07

Guillaume Calmettes authored Jun 05, 2025


[Bugfix] properly catch PIL-related errors for vision models when incorrect data urls are provided (#19202)
Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>

9bc8bb07

04 Jun, 2025 1 commit
- [Core] Cast multimodal input in hf processor (#18862) · 1409ef91
  Lukas Geiger authored Jun 04, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  1409ef91
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
02 Jun, 2025 1 commit

[Model] enable data parallel for Llama4 vision encoder (#18368) · ebb1ec93

jennyyyyzhen authored Jun 02, 2025


Signed-off-by: yzhen <yzhen@devgpu093.cco2.facebook.com>
Co-authored-by: yZhen <yZhen@fb.com>
Co-authored-by: yzhen <yzhen@devgpu093.cco2.facebook.com>

ebb1ec93

28 May, 2025 1 commit
- [Deprecation] Require overriding `get_dummy_text` and `get_dummy_mm_data` (#18796) · 7f2c1a87
  Cyrus Leung authored May 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7f2c1a87
27 May, 2025 2 commits
- [Core] Automatically cast multi-modal input dtype (#18756) · 696259ca
  Cyrus Leung authored May 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  696259ca
- [Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to... · a68e293c
  Hyogeun Oh (오효근) authored May 27, 2025
```
[Doc]  Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  a68e293c
25 May, 2025 2 commits
- [Core][Multimodal] Convert PIL Image to array without data copy when hashing (#18682) · 6071e989
  Lukas Geiger authored May 25, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  6071e989
- [Bugfix] Fix profiling dummy data for Pixtral (#18677) · 57fd13a7
  Cyrus Leung authored May 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  57fd13a7
23 May, 2025 3 commits
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- Replace `{func}` with mkdocs style links (#18610) · 2edb533a
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2edb533a