Commits · ca47e176af9e0a4fa9f02325cdad5f11b40aedab · OpenDAS / vllm_cscc

08 Jan, 2025 1 commit
- [Misc] Move some model utils into vision file (#11848) · ca47e176
  Cyrus Leung authored Jan 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ca47e176
06 Jan, 2025 1 commit

[V1] Extend beyond image modality and support mixed-modality inference with... · 91b361ae

Roger Wang authored Jan 06, 2025


[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685)
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

91b361ae

31 Dec, 2024 1 commit

[V1][VLM] V1 support for selected single-image models. (#11632) · e7c7c5e8

Roger Wang authored Dec 31, 2024


Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Isotr0py <2037008807@qq.com>

e7c7c5e8

27 Dec, 2024 1 commit
- [Misc] Abstract the logic for reading and writing media content (#11527) · 7af553ea
  Cyrus Leung authored Dec 27, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7af553ea
26 Dec, 2024 2 commits
- [Misc] Add placeholder module (#11501) · eec906d8
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  eec906d8
- [Misc] Move some multimodal utils to modality-specific modules (#11494) · 51a624bf
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  51a624bf
25 Dec, 2024 1 commit
- [Frontend] Enable decord to load video from base64 (#11492) · b689ada9
  Cyrus Leung authored Dec 26, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b689ada9
08 Dec, 2024 1 commit
- [V1] Initial support of multimodal models for V1 re-arch (#10699) · a11f3265
  Roger Wang authored Dec 08, 2024
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  a11f3265
21 Nov, 2024 1 commit

[Model] Add Support for Multimodal Granite Models (#10291) · 1cfde82f

Alex Brooks authored Nov 21, 2024


Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

1cfde82f

13 Nov, 2024 1 commit
- [1/N] Initial prototype for multi-modal processor (#10044) · 0b8bb86b
  Cyrus Leung authored Nov 13, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0b8bb86b
08 Nov, 2024 1 commit
- [CI/Build] Update CPU tests to include all "standard" tests (#5481) · b489fc3c
  Cyrus Leung authored Nov 08, 2024
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b489fc3c
07 Nov, 2024 1 commit

Online video support for VLMs (#10020) · 28b2877d

litianjian authored Nov 08, 2024


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>

28b2877d

04 Nov, 2024 1 commit
- [Frontend] Multi-Modality Support for Loading Local Image Files (#9915) · ac6b8f19
  Chauncey authored Nov 04, 2024
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  ac6b8f19
01 Nov, 2024 1 commit
- [Core][VLM] Add precise multi-modal placeholder tracking (#8346) · 6c0b7f54
  Peter Salas authored Nov 01, 2024
```
Signed-off-by: Peter Salas <peter@fixie.ai>
```
  6c0b7f54
11 Sep, 2024 1 commit

[model] Support for Llava-Next-Video model (#7559) · 6a512a00

Yangshen⚡Deng authored Sep 11, 2024


Co-authored-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

6a512a00

04 Sep, 2024 1 commit
- [Frontend] Multimodal support in offline chat (#8098) · 855c262a
  Cyrus Leung authored Sep 04, 2024
  
  855c262a
01 Sep, 2024 1 commit
- [Misc] Optional installation of audio related packages (#8063) · 5b86b199
  Roger Wang authored Sep 01, 2024
  
  5b86b199
27 Aug, 2024 1 commit
- [Model] Add multi-image input support for LLaVA-Next offline inference (#7230) · 5340a2dc
  zifeitong authored Aug 27, 2024
  
  5340a2dc
21 Aug, 2024 1 commit
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8
13 Aug, 2024 1 commit
- [Frontend][Core] Add plumbing to support audio language models (#7446) · 00c3d68e
  Peter Salas authored Aug 13, 2024
  
  00c3d68e
10 Aug, 2024 1 commit
- [Bugfix] Fix phi3v batch inference when images have different aspect ratio (#7392) · 4c5d8e8e
  Isotr0py authored Aug 11, 2024
  
  4c5d8e8e
23 Jul, 2024 1 commit
- [Misc] Manage HTTP connections in one place (#6600) · 97234be0
  Cyrus Leung authored Jul 23, 2024
  
  97234be0
15 Jul, 2024 1 commit
- [Bugfix] Convert image to RGB by default (#6430) · de199163
  Cyrus Leung authored Jul 15, 2024
  
  de199163
03 Jul, 2024 1 commit

[Core] Dynamic image size support for VLMs (#5276) · 9831aec4

Cyrus Leung authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: ywang96 <ywang@roblox.com>
Co-authored-by: xwjiang2010 <87673679+xwjiang2010@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

9831aec4

02 Jul, 2024 1 commit

[VLM] Remove `image_input_type` from VLM config (#5852) · 98d6682c

xwjiang2010 authored Jul 02, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

98d6682c

26 Jun, 2024 1 commit
- [Misc][Doc] Add Example of using OpenAI Server with VLM (#5832) · 3aa7b6cf
  Roger Wang authored Jun 25, 2024
  
  3aa7b6cf
18 Jun, 2024 1 commit
- [Model] Initialize Phi-3-vision support (#4986) · daef218b
  Isotr0py authored Jun 18, 2024
  
  daef218b
10 Jun, 2024 1 commit
- [Bugfix] Fix LLaVA-NeXT (#5380) · 2c0d9335
  Cyrus Leung authored Jun 10, 2024
  
  2c0d9335
07 Jun, 2024 1 commit
- [Frontend] Add OpenAI Vision API Support (#5237) · 7a9cb294
  Roger Wang authored Jun 07, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7a9cb294