Commits · 9389380015b80c109b899a08840132780b9b3fc0 · OpenDAS / vllm_cscc · GitLab

06 Jul, 2024 2 commits
- [Doc] Move guide for multimodal model and other improvements (#6168) · 93893800
  Cyrus Leung authored Jul 06, 2024
  
  93893800
- [Doc] Reorganize Supported Models by Type (#6167) · 175c43ec
  Roger Wang authored Jul 05, 2024
  
  175c43ec
04 Jul, 2024 1 commit
- [VLM] Calculate maximum number of multi-modal tokens by model (#6121) · ae96ef8f
  Cyrus Leung authored Jul 05, 2024
  
  ae96ef8f
03 Jul, 2024 2 commits

[vlm] Remove vision language config. (#6089) · d9e98f42

xwjiang2010 authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

d9e98f42

[Core] Dynamic image size support for VLMs (#5276) · 9831aec4

Cyrus Leung authored Jul 03, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: ywang96 <ywang@roblox.com>
Co-authored-by: xwjiang2010 <87673679+xwjiang2010@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

9831aec4

02 Jul, 2024 2 commits

[Model] Jamba support (#4115) · 9d6a8daa

Mor Zusman authored Jul 03, 2024


Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Erez Schwartz <erezs@ai21.com>
Co-authored-by: Mor Zusman <morz@ai21.com>
Co-authored-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: Tomer Asida <tomera@ai21.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

9d6a8daa

[VLM] Remove `image_input_type` from VLM config (#5852) · 98d6682c

xwjiang2010 authored Jul 02, 2024


Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

98d6682c

28 Jun, 2024 1 commit
- [Core] Registry for processing model inputs (#5214) · 5cbe8d15
  Cyrus Leung authored Jun 28, 2024
```
Co-authored-by: ywang96 <ywang@roblox.com>
```
  5cbe8d15
27 Jun, 2024 2 commits
- [Model] Add Gemma 2 (#5908) · 79c92c7c
  Woosuk Kwon authored Jun 27, 2024
  
  79c92c7c
- [Model] Add base class for LoRA-supported models (#5018) · 96354d6a
  Cyrus Leung authored Jun 27, 2024
  
  96354d6a
26 Jun, 2024 1 commit
- [Misc][Doc] Add Example of using OpenAI Server with VLM (#5832) · 3aa7b6cf
  Roger Wang authored Jun 25, 2024
  
  3aa7b6cf
25 Jun, 2024 1 commit
- [Doc] Add notice about breaking changes to VLMs (#5818) · f23871e9
  Cyrus Leung authored Jun 25, 2024
  
  f23871e9
24 Jun, 2024 1 commit
- [Doc] Add Phi-3-medium to list of supported models (#5788) · 1744cc99
  Michael Goin authored Jun 24, 2024
  
  1744cc99
18 Jun, 2024 1 commit
- [Model] Initialize Phi-3-vision support (#4986) · daef218b
  Isotr0py authored Jun 18, 2024
  
  daef218b
13 Jun, 2024 1 commit
- [Doc] Update LLaVA docs (#5437) · 0ce7b952
  Cyrus Leung authored Jun 14, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  0ce7b952
11 Jun, 2024 3 commits
- [Docs] [Spec decode] Fix docs error in code example (#5427) · 89ec06c3
  Cade Daniel authored Jun 11, 2024
  
  89ec06c3
- [Speculative decoding] Initial spec decode docs (#5400) · 4c2ffb28
  Cade Daniel authored Jun 11, 2024
  
  4c2ffb28
- [CI] docfix (#5410) · 246598a6
  SangBin Cho authored Jun 11, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: ywang96 <ywang@roblox.com>
```
  246598a6
10 Jun, 2024 2 commits
- [Docs] Add Docs on Limitations of VLM Support (#5383) · 856c9900
  Roger Wang authored Jun 10, 2024
  
  856c9900
- [Model] Initial support for LLaVA-NeXT (#4199) · 6b29d6fe
  Cyrus Leung authored Jun 10, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  6b29d6fe
07 Jun, 2024 1 commit
- [Frontend] Add OpenAI Vision API Support (#5237) · 7a9cb294
  Roger Wang authored Jun 07, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7a9cb294
03 Jun, 2024 1 commit
- [Core] Support image processor (#4197) · 7a64d24a
  Cyrus Leung authored Jun 03, 2024
  
  7a64d24a
01 Jun, 2024 1 commit
- [Doc] Add checkmark for GPTBigCodeForCausalLM LoRA support (#5171) · 65757911
  Nick Hill authored May 31, 2024
  
  65757911
25 May, 2024 1 commit

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) · 8e192ff9

Eric Xihui Lin authored May 25, 2024


Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

8e192ff9

21 May, 2024 1 commit
- [Model] Add Phi-2 LoRA support (#4886) · f12c3b5b
  Isotr0py authored May 21, 2024
  
  f12c3b5b
13 May, 2024 2 commits
- [Doc] Shorten README by removing supported model list (#4796) · ac1fbf7f
  Zhuohan Li authored May 13, 2024
  
  ac1fbf7f
- [Scheduler] Warning upon preemption and Swapping (#4647) · e7c46b95
  SangBin Cho authored May 13, 2024
```
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
```
  e7c46b95
10 May, 2024 1 commit

chunked-prefill-doc-syntax (#4603) · 51d4094f

Simon Mo authored May 09, 2024

Fix the docs: https://docs.vllm.ai/en/latest/models/performance.html

Co-authored-by: sang <rkooo567@gmail.com>

51d4094f

04 May, 2024 1 commit
- [Doc] Chunked Prefill Documentation (#4580) · 36fb68f9
  SangBin Cho authored May 04, 2024
  
  36fb68f9
25 Apr, 2024 2 commits
- [Bugfix][Model] Refactor OLMo model to support new HF format in transformers 4.40.0 (#4324) · fbf152d9
  Isotr0py authored Apr 26, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  fbf152d9
- [Model] Adds Phi-3 support (#4298) · 96e90fde
  Caio Mendes authored Apr 25, 2024
  
  96e90fde
21 Apr, 2024 2 commits
- [Doc]: Update the doc of adding new models (#4236) · 7f2593b1
  xiaoji authored Apr 22, 2024
  
  7f2593b1
- Don't show default value for flags in `EngineArgs` (#4223) · fe7d648f
  Harry Mellor authored Apr 21, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  fe7d648f
20 Apr, 2024 1 commit
- Fix missing docs and out of sync `EngineArgs` (#4219) · 682789d4
  Harry Mellor authored Apr 20, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  682789d4
18 Apr, 2024 1 commit
- [Docs] document that Meta Llama 3 is supported (#4175) · 705578ae
  Simon Mo authored Apr 18, 2024
  
  705578ae
15 Apr, 2024 1 commit
- [Doc] Add better clarity for tensorizer usage (#4090) · d619ae2d
  Sanger Steel authored Apr 15, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  d619ae2d
14 Apr, 2024 2 commits
- [Docs] document that mixtral 8x22b is supported (#4073) · aceb17cf
  Simon Mo authored Apr 14, 2024
  
  aceb17cf
- [Frontend] [Core] feat: Add model loading using `tensorizer` (#3476) · 711a0002
  Sanger Steel authored Apr 13, 2024
  
  711a0002
10 Apr, 2024 1 commit
- [Doc] Add doc to state our model support policy (#3948) · e3539746
  youkaichao authored Apr 10, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  e3539746
08 Apr, 2024 1 commit
- [Model] add minicpm (#3893) · b4543c8f
  ywfang authored Apr 08, 2024
  
  b4543c8f