Commits · f48954a4beb1c0507132d97554358ba00fd83d0a · OpenDAS / vllm_cscc

11 Jun, 2024 3 commits
- [Docs] [Spec decode] Fix docs error in code example (#5427) · 89ec06c3
  Cade Daniel authored Jun 11, 2024
  
  89ec06c3
- [Speculative decoding] Initial spec decode docs (#5400) · 4c2ffb28
  Cade Daniel authored Jun 11, 2024
  
  4c2ffb28
- [CI] docfix (#5410) · 246598a6
  SangBin Cho authored Jun 11, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: ywang96 <ywang@roblox.com>
```
  246598a6
10 Jun, 2024 2 commits
- [Docs] Add Docs on Limitations of VLM Support (#5383) · 856c9900
  Roger Wang authored Jun 10, 2024
  
  856c9900
- [Model] Initial support for LLaVA-NeXT (#4199) · 6b29d6fe
  Cyrus Leung authored Jun 10, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  6b29d6fe
07 Jun, 2024 1 commit
- [Frontend] Add OpenAI Vision API Support (#5237) · 7a9cb294
  Roger Wang authored Jun 07, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7a9cb294
03 Jun, 2024 1 commit
- [Core] Support image processor (#4197) · 7a64d24a
  Cyrus Leung authored Jun 03, 2024
  
  7a64d24a
01 Jun, 2024 1 commit
- [Doc] Add checkmark for GPTBigCodeForCausalLM LoRA support (#5171) · 65757911
  Nick Hill authored May 31, 2024
  
  65757911
25 May, 2024 1 commit

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) · 8e192ff9

Eric Xihui Lin authored May 25, 2024


Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

8e192ff9

21 May, 2024 1 commit
- [Model] Add Phi-2 LoRA support (#4886) · f12c3b5b
  Isotr0py authored May 21, 2024
  
  f12c3b5b
13 May, 2024 2 commits
- [Doc] Shorten README by removing supported model list (#4796) · ac1fbf7f
  Zhuohan Li authored May 13, 2024
  
  ac1fbf7f
- [Scheduler] Warning upon preemption and Swapping (#4647) · e7c46b95
  SangBin Cho authored May 13, 2024
```
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
```
  e7c46b95
10 May, 2024 1 commit

chunked-prefill-doc-syntax (#4603) · 51d4094f

Simon Mo authored May 09, 2024

Fix the docs: https://docs.vllm.ai/en/latest/models/performance.html

Co-authored-by: sang <rkooo567@gmail.com>

51d4094f

04 May, 2024 1 commit
- [Doc] Chunked Prefill Documentation (#4580) · 36fb68f9
  SangBin Cho authored May 04, 2024
  
  36fb68f9
25 Apr, 2024 2 commits
- [Bugfix][Model] Refactor OLMo model to support new HF format in transformers 4.40.0 (#4324) · fbf152d9
  Isotr0py authored Apr 26, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  fbf152d9
- [Model] Adds Phi-3 support (#4298) · 96e90fde
  Caio Mendes authored Apr 25, 2024
  
  96e90fde
21 Apr, 2024 2 commits
- [Doc]: Update the doc of adding new models (#4236) · 7f2593b1
  xiaoji authored Apr 22, 2024
  
  7f2593b1
- Don't show default value for flags in `EngineArgs` (#4223) · fe7d648f
  Harry Mellor authored Apr 21, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  fe7d648f
20 Apr, 2024 1 commit
- Fix missing docs and out of sync `EngineArgs` (#4219) · 682789d4
  Harry Mellor authored Apr 20, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  682789d4
18 Apr, 2024 1 commit
- [Docs] document that Meta Llama 3 is supported (#4175) · 705578ae
  Simon Mo authored Apr 18, 2024
  
  705578ae
15 Apr, 2024 1 commit
- [Doc] Add better clarity for tensorizer usage (#4090) · d619ae2d
  Sanger Steel authored Apr 15, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  d619ae2d
14 Apr, 2024 2 commits
- [Docs] document that mixtral 8x22b is supported (#4073) · aceb17cf
  Simon Mo authored Apr 14, 2024
  
  aceb17cf
- [Frontend] [Core] feat: Add model loading using `tensorizer` (#3476) · 711a0002
  Sanger Steel authored Apr 13, 2024
  
  711a0002
10 Apr, 2024 1 commit
- [Doc] Add doc to state our model support policy (#3948) · e3539746
  youkaichao authored Apr 10, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  e3539746
08 Apr, 2024 1 commit
- [Model] add minicpm (#3893) · b4543c8f
  ywfang authored Apr 08, 2024
  
  b4543c8f
07 Apr, 2024 1 commit
- [Core] enable out-of-tree model register (#3871) · 95baec82
  youkaichao authored Apr 06, 2024
  
  95baec82
05 Apr, 2024 1 commit

[Doc]Add asynchronous engine arguments to documentation. (#3810) · 78107fa0

Sean Gallen authored Apr 04, 2024


Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

78107fa0

28 Mar, 2024 1 commit
- [Model] Add support for Qwen2MoeModel (#3346) · d6ea427f
  wenyujin333 authored Mar 28, 2024
  
  d6ea427f
27 Mar, 2024 4 commits
- [Docs] Add Command-R to supported models (#3669) · 6d9aa00f
  Woosuk Kwon authored Mar 27, 2024
  
  6d9aa00f
- [Model] Add support for DBRX (#3660) · e24336b5
  Megha Agarwal authored Mar 27, 2024
  
  e24336b5
- [Misc] Minor fix in KVCache type (#3652) · e66b629c
  Woosuk Kwon authored Mar 26, 2024
  
  e66b629c
- [Doc]add lora support (#3649) · 76879342
  Jee Li authored Mar 27, 2024
  
  76879342
21 Mar, 2024 1 commit
- [🚀 Ready to be merged] Added support for Jais models (#3183) · 4c07dd28
  Lalit Pradhan authored Mar 21, 2024
  
  4c07dd28
19 Mar, 2024 1 commit
- [Doc] Add docs about OpenAI compatible server (#3288) · ef65dcfa
  Simon Mo authored Mar 18, 2024
  
  ef65dcfa
11 Mar, 2024 1 commit
- [docs] Add LoRA support information for models (#3299) · 657061fd
  Philipp Moritz authored Mar 11, 2024
  
  657061fd
02 Mar, 2024 1 commit

Add Automatic Prefix Caching (#2762) · ce4f5a29

Sage Moore authored Mar 02, 2024


Co-authored-by: ElizaWszola <eliza@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

ce4f5a29

28 Feb, 2024 1 commit
- multi-lora documentation fix (#3064) · a8683102
  Ganesh Jagadeesan authored Feb 28, 2024
  
  a8683102
27 Feb, 2024 2 commits
- [Minor] Fix StableLMEpochForCausalLM -> StableLmForCausalLM (#3046) · 8b430d7d
  Woosuk Kwon authored Feb 26, 2024
  
  8b430d7d
- Support Orion model (#2539) · 48a8f4a7
  张大成 authored Feb 27, 2024
```
Co-authored-by: zhangdacheng <zhangdacheng@ainirobot.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  48a8f4a7
21 Feb, 2024 1 commit
- [FIX] Add Gemma model to the doc (#2966) · a9c82128
  Zhuohan Li authored Feb 21, 2024
  
  a9c82128