Commits · d054da1992175787f936d18aead51bef663a0399 · OpenDAS / vllm_cscc

02 Jun, 2025 1 commit

[Model] enable data parallel for Llama4 vision encoder (#18368) · ebb1ec93

jennyyyyzhen authored Jun 02, 2025


Signed-off-by: yzhen <yzhen@devgpu093.cco2.facebook.com>
Co-authored-by: yZhen <yZhen@fb.com>
Co-authored-by: yzhen <yzhen@devgpu093.cco2.facebook.com>

ebb1ec93

28 May, 2025 1 commit
- [Deprecation] Require overriding `get_dummy_text` and `get_dummy_mm_data` (#18796) · 7f2c1a87
  Cyrus Leung authored May 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7f2c1a87
27 May, 2025 2 commits
- [Core] Automatically cast multi-modal input dtype (#18756) · 696259ca
  Cyrus Leung authored May 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  696259ca
- [Doc] Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to... · a68e293c
  Hyogeun Oh (오효근) authored May 27, 2025
```
[Doc]  Convert Sphinx directives ( `{class}`, `{meth}`, `{attr}`, ...) to MkDocs format for better documentation linking (#18663)
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  a68e293c
25 May, 2025 2 commits
- [Core][Multimodal] Convert PIL Image to array without data copy when hashing (#18682) · 6071e989
  Lukas Geiger authored May 25, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  6071e989
- [Bugfix] Fix profiling dummy data for Pixtral (#18677) · 57fd13a7
  Cyrus Leung authored May 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  57fd13a7
23 May, 2025 5 commits
- [Bugfix] Migrate to REGEX Library to prevent catastrophic backtracking (#18454) · 4fc1bf81
  Feng XiaoLong authored May 24, 2025
```
Signed-off-by: Crucifixion-Fxl <xmufxl@gmail.com>
Co-authored-by: Crucifixion-Fxl <xmufxl@gmail.com>
```
  4fc1bf81
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- Replace `{func}` with mkdocs style links (#18610) · 2edb533a
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2edb533a
- Migrate docs from Sphinx to MkDocs (#18145) · a1fe24d9
  Harry Mellor authored May 23, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a1fe24d9
- Re-submit: Fix: Proper RGBA -> RGB conversion for PIL images. (#18569) · 04eb88dc
  Chenheli Hua authored May 22, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  04eb88dc
22 May, 2025 1 commit
- [Misc] Call `ndarray.tobytes()` directly instead of `ndarray.data.tobytes()` (#18347) · 54631f82
  Lukas Geiger authored May 22, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  54631f82
15 May, 2025 1 commit
- Support custom implementations of VideoLoader backends. (#18091) · 4f07a640
  Chenheli Hua authored May 14, 2025
  
  4f07a640
14 May, 2025 1 commit
- [Frontend] decrease import time of vllm.multimodal (#18031) · 749f7925
  David Xia authored May 14, 2025
```
Co-authored-by: Aaron Pham <Aaronpham0103@gmail.com>
```
  749f7925
13 May, 2025 1 commit
- [Bugfix] Avoid repeatedly creating dummy data during engine startup (#17935) · 61e0a506
  Cyrus Leung authored May 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  61e0a506
07 May, 2025 1 commit
- [Bugfix] Fix Video IO error for short video (#17791) · be8ff88e
  Isotr0py authored May 07, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  be8ff88e
04 May, 2025 1 commit
- Add full API docs and improve the UX of navigating them (#17485) · d6484ef3
  Harry Mellor authored May 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6484ef3
02 May, 2025 2 commits
- [Misc] Clean up input processing (#17582) · cb234955
  Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cb234955
- [Security] Fix image hash collision (#17378) · 99404f53
  Cyrus Leung authored May 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  99404f53
30 Apr, 2025 2 commits
- [Fix] Support passing args to logger (#17425) · da4e7687
  Aaron Pham authored Apr 30, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  da4e7687
- [Core] Prevent side-channel attacks via cache salting (#17045) · 77073c77
  Marko Rosenmueller authored Apr 30, 2025
```
Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>
```
  77073c77
29 Apr, 2025 2 commits
- [Misc] Move config fields to MultiModalConfig (#17343) · ebb3930d
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ebb3930d
- [Optim] Compute multimodal hash only once per item (#17314) · 506475de
  Cyrus Leung authored Apr 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  506475de
28 Apr, 2025 2 commits
- [Misc] Clean up Qwen2.5-Omni code (#17301) · 8b464d96
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8b464d96
- [Core] Remove legacy input mapper/processor from V0 (#15686) · aec9674d
  Cyrus Leung authored Apr 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aec9674d
19 Apr, 2025 2 commits

[Model] Refactor Phi-4-multimodal to use merged processor and support V1 (#15477) · 83f3c3bd

Isotr0py authored Apr 19, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

83f3c3bd

[Model][VLM] Add Qwen2.5-Omni model support (thinker only) (#15130) · 2c1bd848

Yang Fan authored Apr 19, 2025


Signed-off-by: fyabc <suyang.fy@alibaba-inc.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Xiong Wang <wangxiongts@163.com>

2c1bd848

18 Apr, 2025 1 commit
- Improve-mm-and-pooler-and-decoding-configs (#16789) · e78587a6
  Harry Mellor authored Apr 18, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e78587a6
12 Apr, 2025 1 commit
- [V1] Enable multi-input by default (#15799) · d9fc8cd9
  Cyrus Leung authored Apr 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d9fc8cd9
10 Apr, 2025 3 commits
- [VLM] Avoid unnecessary dummy multimodal data during processing (#16416) · 56d4aefa
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56d4aefa
- [VLM] Remove `BaseProcessingInfo.get_mm_max_tokens_per_item` (#16408) · 83b824c8
  Cyrus Leung authored Apr 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  83b824c8
- [bugfix] Avoid the time consumption caused by creating dummy videos. (#16371) · 4aed0ca6
  Jintao authored Apr 10, 2025
  
  4aed0ca6
08 Apr, 2025 2 commits

[Bugfix] Proper input validation for multi-modal encoder-decoder models (#16156) · 4ebc0b96
Cyrus Leung authored Apr 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
4ebc0b96

[V1] Scatter and gather placeholders in the model runner (#16076) · f2ebb6f5

Roger Wang authored Apr 07, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>

f2ebb6f5

07 Apr, 2025 2 commits
- Print the warning only once (#16193) · ad434d4c
  Gregory Shtrasberg authored Apr 07, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  ad434d4c
- [Bugfix] Make dummy encoder prompt padding alternative and add missing warnings (#16129) · fc0f8776
  Isotr0py authored Apr 07, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  fc0f8776
04 Apr, 2025 2 commits

Revert "[V1] Scatter and gather placeholders in the model runner" (#16075) · af51d80f
Roger Wang authored Apr 04, 2025

af51d80f

[V1] Scatter and gather placeholders in the model runner (#15712) · f5722a50

Cyrus Leung authored Apr 05, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

f5722a50

01 Apr, 2025 2 commits
- [Misc] Allow using OpenCV as video IO fallback (#15055) · 4e5a0f6a
  Isotr0py authored Apr 01, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4e5a0f6a
- [Bugfix] Fix no video/image profiling edge case for `MultiModalDataParser` (#15828) · 0a298ea4
  Isotr0py authored Apr 01, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  0a298ea4