Commits · 8c38ee7007c50ac5aef9ed43ae91c6f031799c40 · OpenDAS / vllm_cscc

02 Jan, 2025 1 commit
- [VLM] Merged multi-modal processor for LLaVA-NeXT (#11682) · 8c38ee70
  Cyrus Leung authored Jan 03, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8c38ee70
01 Jan, 2025 1 commit

[VLM] Move supported limits and max tokens to merged multi-modal processor (#11669) · a115ac46

Cyrus Leung authored Jan 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

a115ac46

30 Dec, 2024 1 commit
- [VLM] Abstract out multi-modal data parsing in merged processor (#11620) · 8d9b6721
  Cyrus Leung authored Dec 30, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  8d9b6721
27 Dec, 2024 1 commit
- [VLM] Support caching in merged multi-modal processor (#11396) · 10141809
  Cyrus Leung authored Dec 28, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  10141809
24 Dec, 2024 1 commit
- [Misc] Move weights mapper (#11443) · 196c34b0
  Jee Jee Li authored Dec 24, 2024
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  196c34b0
19 Dec, 2024 1 commit
- [VLM] Merged multimodal processor for Qwen2-Audio (#11303) · 6142ef0a
  Cyrus Leung authored Dec 19, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6142ef0a
18 Dec, 2024 1 commit
- [Bugfix] Fix broken phi3-v mm_processor_kwargs tests (#11263) · 996aa70f
  Isotr0py authored Dec 19, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  996aa70f
14 Dec, 2024 1 commit
- [VLM] Fully dynamic prompt replacement in merged input processor (#11199) · 93abf23a
  Cyrus Leung authored Dec 15, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  93abf23a
09 Dec, 2024 1 commit
- [Model] merged input processor for Phi-3-Vision models (#10977) · a811dd66
  Isotr0py authored Dec 10, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  a811dd66
01 Dec, 2024 1 commit
- [Model] Replace embedding models with pooling adapter (#10769) · 13370712
  Cyrus Leung authored Dec 01, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13370712
26 Nov, 2024 1 commit
- [V1] Refactor model executable interface for multimodal models (#10570) · 2f0a0a17
  Roger Wang authored Nov 26, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  2f0a0a17
18 Nov, 2024 1 commit
- [Misc] Add uninitialized params tracking for `AutoWeightsLoader` (#10327) · c4e46433
  Isotr0py authored Nov 18, 2024
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  c4e46433
13 Nov, 2024 2 commits
- [1/N] Initial prototype for multi-modal processor (#10044) · 0b8bb86b
  Cyrus Leung authored Nov 13, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0b8bb86b
- [V1] Support VLMs with fine-grained scheduling (#9871) · bbd3e869
  Woosuk Kwon authored Nov 12, 2024
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  bbd3e869
11 Nov, 2024 1 commit
- [6/N] pass whole config to inner model (#10205) · f89d18ff
  youkaichao authored Nov 10, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f89d18ff
09 Nov, 2024 1 commit
- [5/N] pass the whole config to model (#9983) · 1a95f10e
  youkaichao authored Nov 08, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  1a95f10e
06 Nov, 2024 2 commits
- [V1] Make v1 more testable (#9888) · d58268c5
  Joe Runde authored Nov 06, 2024
```
Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>
```
  d58268c5
- [CI/Build] drop support for Python 3.8 EOL (#8464) · 21063c11
  Aaron Pham authored Nov 06, 2024
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  21063c11
01 Nov, 2024 2 commits
- [Core][VLM] Add precise multi-modal placeholder tracking (#8346) · 6c0b7f54
  Peter Salas authored Nov 01, 2024
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  6c0b7f54
- [torch.compile] rework test plans (#9866) · 566cd277
  youkaichao authored Oct 31, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  566cd277
30 Oct, 2024 1 commit
- [Model] Support math-shepherd-mistral-7b-prm model (#9697) · 81f09cfd
  Went-Liang authored Oct 31, 2024
```
Signed-off-by: Went-Liang <wenteng_liang@163.com>
```
  81f09cfd
29 Oct, 2024 1 commit
- [Bugfix] Fix prefix strings for quantized VLMs (#9772) · bc73e982
  Michael Goin authored Oct 29, 2024
  
  bc73e982
23 Oct, 2024 2 commits
- [VLM] Enable overriding whether post layernorm is used in vision encoder + fix quant args (#9217) · c18e1a34
  Cyrus Leung authored Oct 23, 2024
```
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  c18e1a34
- [Model] Support E5-V (#9576) · 831540cf
  Cyrus Leung authored Oct 23, 2024
  
  831540cf
16 Oct, 2024 2 commits
- [Core] Rename input data types (#8688) · cee711fd
  Cyrus Leung authored Oct 16, 2024
  
  cee711fd
- [Model] VLM2Vec, the first multimodal embedding model in vLLM (#9303) · 7abba39e
  Cyrus Leung authored Oct 16, 2024
  
  7abba39e
09 Oct, 2024 1 commit
- [Bugfix] fix composite weight loading and EAGLE weight loading (#9160) · 8bfaa4e3
  Cyrus Leung authored Oct 09, 2024
  
  8bfaa4e3
05 Oct, 2024 1 commit
- [Bugfix] Fixes Phi3v & Ultravox Multimodal EmbeddingInputs (#8979) · 53b3a330
  hhzhang16 authored Oct 04, 2024
  
  53b3a330
04 Oct, 2024 1 commit

[Models] Add remaining model PP support (#7168) · 0f6d7a9a

Murali Andoorveedu authored Oct 03, 2024

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Signed-off-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

0f6d7a9a

24 Sep, 2024 1 commit

[Model] Expose Phi3v num_crops as a mm_processor_kwarg (#8658) · 8ff7ced9

Alex Brooks authored Sep 24, 2024


Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

8ff7ced9

07 Sep, 2024 1 commit
- [Model] Multi-input support for LLaVA (#8238) · 2f707fcb
  Cyrus Leung authored Sep 07, 2024
  
  2f707fcb
30 Aug, 2024 2 commits
- [VLM][Model] TP support for ViTs (#7186) · f97be32d
  Jungho Christopher Cho authored Aug 31, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  f97be32d
- [Core] Logprobs support in Multi-step (#7652) · 428dd144
  afeldman-nm authored Aug 29, 2024
  
  428dd144
28 Aug, 2024 2 commits
- [Bugfix][VLM] Fix incompatibility between #7902 and #7230 (#7948) · ef9baee3
  Cyrus Leung authored Aug 28, 2024
  
  ef9baee3
- [Core][VLM] Stack multimodal tensors to represent multiple images within each prompt (#7902) · fab5f53e
  Peter Salas authored Aug 27, 2024
  
  fab5f53e
27 Aug, 2024 1 commit
- [Bugfix] Fix phi3v incorrect image_idx when using async engine (#7916) · b09c755b
  Isotr0py authored Aug 28, 2024
  
  b09c755b
25 Aug, 2024 2 commits
- [Model][VLM] Support multi-images inputs for Phi-3-vision models (#7783) · 8aaf3d53
  Isotr0py authored Aug 25, 2024
  
  8aaf3d53
- [Bugfix] Fix Phi-3v crash when input images are of certain sizes (#7840) · 80162c44
  zifeitong authored Aug 24, 2024
  
  80162c44
22 Aug, 2024 1 commit
- [Model] Fix Phi-3.5-vision-instruct 'num_crops' issue (#7710) · df1a2113
  zifeitong authored Aug 21, 2024
  
  df1a2113
21 Aug, 2024 1 commit
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8