Commits · 41e95c5247c9703c3e11f3b563d8bba70ed31aca · OpenDAS / vllm_cscc · GitLab

06 Sep, 2024 1 commit
- [Core] Support load and unload LoRA in api server (#6566) · db3bf7c9
  Jiaxin Shan authored Sep 05, 2024
```
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  db3bf7c9
05 Sep, 2024 3 commits
- [Documentation][Spec Decode] Add documentation about lossless guarantees in... · 2febcf27
  sroy745 authored Sep 05, 2024
```
[Documentation][Spec Decode] Add documentation about lossless guarantees in Speculative Decoding in vLLM (#7962)
```
  2febcf27
- [MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029) · 9da25a88
  Alex Brooks authored Sep 05, 2024
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9da25a88
- [Doc] Indicate more information about supported modalities (#8181) · 288a9388
  Cyrus Leung authored Sep 05, 2024
  
  288a9388
30 Aug, 2024 2 commits
- [Model] Adding support for MSFT Phi-3.5-MoE (#7729) · 1248e850
  Wenxiang authored Aug 31, 2024
```
Co-authored-by: Your Name <you@example.com>
Co-authored-by: Zeqi Lin <zelin@microsoft.com>
Co-authored-by: Zeqi Lin <Zeqi.Lin@microsoft.com>
```
  1248e850
- [MODEL] add Exaone model support (#7819) · dc13e993
  Yohan Na authored Aug 30, 2024
  
  dc13e993
22 Aug, 2024 2 commits
- [Doc] Fix incorrect docs from #7615 (#7788) · 57792ed4
  Peter Salas authored Aug 22, 2024
  
  57792ed4
- [Model] Fix Phi-3.5-vision-instruct 'num_crops' issue (#7710) · df1a2113
  zifeitong authored Aug 21, 2024
  
  df1a2113
21 Aug, 2024 2 commits
- [Model] Add UltravoxModel and UltravoxConfig (#7615) · 1ca0d4f8
  Peter Salas authored Aug 21, 2024
  
  1ca0d4f8
- [Doc] Section for Multimodal Language Models (#7719) · 45066412
  Roger Wang authored Aug 20, 2024
  
  45066412
14 Aug, 2024 1 commit
- [VLM][Core] Support profiling with multiple multi-modal inputs per prompt (#7126) · 3f674a49
  Cyrus Leung authored Aug 15, 2024
  
  3f674a49
13 Aug, 2024 1 commit
- [Frontend][Core] Add plumbing to support audio language models (#7446) · 00c3d68e
  Peter Salas authored Aug 13, 2024
  
  00c3d68e
12 Aug, 2024 1 commit
- [Core][VLM] Support image embeddings as input (#6613) · e6e42e4b
  Roger Wang authored Aug 12, 2024
  
  e6e42e4b
08 Aug, 2024 1 commit
- [Model] Rename MiniCPMVQwen2 to MiniCPMV2.6 (#7273) · 757ac70a
  Jee Jee Li authored Aug 08, 2024
  
  757ac70a
07 Aug, 2024 1 commit
- [Doc] add online speculative decoding example (#7243) · 0e12cd67
  Stas Bekman authored Aug 07, 2024
  
  0e12cd67
05 Aug, 2024 1 commit
- [Doc] [SpecDecode] Update MLPSpeculator documentation (#7100) · 789937af
  Thomas Parnell authored Aug 06, 2024
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  789937af
04 Aug, 2024 1 commit
- [Model]Refactor MiniCPMV (#7020) · 179a6a36
  Jee Jee Li authored Aug 04, 2024
```
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  179a6a36
31 Jul, 2024 1 commit

[Bugfix] Clean up MiniCPM-V (#6939) · 2f4e108f

Alphi authored Jul 31, 2024


Co-authored-by: hezhihui <hzh7269@modelbest.cn>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

2f4e108f

29 Jul, 2024 1 commit
- [Model] Initialize support for InternVL2 series models (#6514) · 7cbd9ec7
  Isotr0py authored Jul 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  7cbd9ec7
27 Jul, 2024 2 commits
- [Model] Initial support for BLIP-2 (#5920) · 1ad86acf
  Cyrus Leung authored Jul 27, 2024
```
Co-authored-by: ywang96 <ywang@roblox.com>
```
  1ad86acf
- [CI/Build][Doc] Update CI and Doc for VLM example changes (#6860) · ecb33a28
  Roger Wang authored Jul 27, 2024
  
  ecb33a28
26 Jul, 2024 1 commit
- [Doc] Add Nemotron to supported model docs (#6843) · 281977bd
  Michael Goin authored Jul 26, 2024
  
  281977bd
25 Jul, 2024 1 commit
- [Model] Adding support for MiniCPM-V (#4087) · 9e169a4c
  Alphi authored Jul 25, 2024
  
  9e169a4c
23 Jul, 2024 2 commits
- [Docs] Announce llama3.1 support (#6688) · cb1362a8
  Woosuk Kwon authored Jul 23, 2024
  
  cb1362a8
- [VLM][Model] Support image input for Chameleon (#6633) · 22fa2e35
  Roger Wang authored Jul 22, 2024
  
  22fa2e35
22 Jul, 2024 1 commit
- [Frontend] Refactor prompt processing (#4028) · 739b61a3
  Cyrus Leung authored Jul 23, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  739b61a3
17 Jul, 2024 1 commit
- [Doc][CI/Build] Update docs and tests to use `vllm serve` (#6431) · 5bf35a91
  Cyrus Leung authored Jul 17, 2024
  
  5bf35a91
16 Jul, 2024 1 commit
- [Doc] Fix the lora adapter path in server startup script (#6230) · 94162beb
  Jiaxin Shan authored Jul 16, 2024
  
  94162beb
14 Jul, 2024 2 commits
- Remove unnecessary trailing period in spec_decode.rst (#6405) · 6ef3bf91
  Yuan Tang authored Jul 14, 2024
  
  6ef3bf91
- [Model] Initialize Fuyu-8B support (#3924) · 540c0368
  Isotr0py authored Jul 14, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  540c0368
07 Jul, 2024 1 commit
- [Model] Add PaliGemma (#5189) · 6206dcb2
  Roger Wang authored Jul 06, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6206dcb2
06 Jul, 2024 2 commits
- [Doc] Move guide for multimodal model and other improvements (#6168) · 93893800
  Cyrus Leung authored Jul 06, 2024
  
  93893800
- [Doc] Reorganize Supported Models by Type (#6167) · 175c43ec
  Roger Wang authored Jul 05, 2024
  
  175c43ec
04 Jul, 2024 1 commit
- [VLM] Calculate maximum number of multi-modal tokens by model (#6121) · ae96ef8f
  Cyrus Leung authored Jul 05, 2024
  
  ae96ef8f
03 Jul, 2024 2 commits

[vlm] Remove vision language config. (#6089) · d9e98f42

xwjiang2010 authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

d9e98f42

[Core] Dynamic image size support for VLMs (#5276) · 9831aec4

Cyrus Leung authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: ywang96 <ywang@roblox.com>
Co-authored-by: xwjiang2010 <87673679+xwjiang2010@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

9831aec4

02 Jul, 2024 2 commits

[Model] Jamba support (#4115) · 9d6a8daa

Mor Zusman authored Jul 03, 2024


Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Erez Schwartz <erezs@ai21.com>
Co-authored-by: Mor Zusman <morz@ai21.com>
Co-authored-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: Tomer Asida <tomera@ai21.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

9d6a8daa

[VLM] Remove `image_input_type` from VLM config (#5852) · 98d6682c

xwjiang2010 authored Jul 02, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

98d6682c

28 Jun, 2024 1 commit
- [Core] Registry for processing model inputs (#5214) · 5cbe8d15
  Cyrus Leung authored Jun 28, 2024
```
Co-authored-by: ywang96 <ywang@roblox.com>
```
  5cbe8d15
27 Jun, 2024 1 commit
- [Model] Add Gemma 2 (#5908) · 79c92c7c
  Woosuk Kwon authored Jun 27, 2024
  
  79c92c7c