Commits · 0bfa1c4f133737a59bcb94e85ca80f2f4cd68038 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "37241077d563d5808ce8f36ebce4eec25e1c1f88"

07 Jun, 2024 1 commit
- [Frontend] Add OpenAI Vision API Support (#5237) · 7a9cb294
  Roger Wang authored Jun 07, 2024
```
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7a9cb294
05 Jun, 2024 1 commit
- [Docs] Add Sequoia as sponsors (#5287) · f270a395
  Simon Mo authored Jun 05, 2024
  
  f270a395
04 Jun, 2024 1 commit
- [Bugfix] Fix a bug caused by pip install setuptools>=49.4.0 for CPU backend (#5249) · 87d5abef
  Jie Fu (傅杰) authored Jun 05, 2024
  
  87d5abef
03 Jun, 2024 2 commits
- [FRONTEND] OpenAI `tools` support named functions (#5032) · f775a07e
  Breno Faria authored Jun 04, 2024
  
  f775a07e
- [Core] Support image processor (#4197) · 7a64d24a
  Cyrus Leung authored Jun 03, 2024
  
  7a64d24a
01 Jun, 2024 1 commit
- [Doc] Add checkmark for GPTBigCodeForCausalLM LoRA support (#5171) · 65757911
  Nick Hill authored May 31, 2024
  
  65757911
30 May, 2024 2 commits
- add doc about serving option on dstack (#3074) · 429d8972
  Chansung Park authored May 31, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  429d8972
- [Doc] Use intersphinx and update entrypoints docs (#5125) · a9bcc7af
  Cyrus Leung authored May 31, 2024
  
  a9bcc7af
29 May, 2024 1 commit
- [Doc][Build] update after removing vllm-nccl (#5103) · 4fbcb0f2
  youkaichao authored May 29, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  4fbcb0f2
28 May, 2024 2 commits
- [Core] Consolidate prompt arguments to LLM engines (#4328) · 5ae5ed1e
  Cyrus Leung authored May 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  5ae5ed1e
- [Docs] Add Dropbox as sponsors (#5089) · 290f4ada
  Simon Mo authored May 28, 2024
  
  290f4ada
25 May, 2024 1 commit

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) · 8e192ff9

Eric Xihui Lin authored May 25, 2024


Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

8e192ff9

23 May, 2024 1 commit
- [Doc] add ccache guide in doc (#5012) · 6a50f4ca
  youkaichao authored May 23, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  6a50f4ca
21 May, 2024 2 commits
- [Docs] Add acknowledgment for sponsors (#4925) · e941f885
  Simon Mo authored May 21, 2024
  
  e941f885
- [Model] Add Phi-2 LoRA support (#4886) · f12c3b5b
  Isotr0py authored May 21, 2024
  
  f12c3b5b
16 May, 2024 1 commit
- Support to serve vLLM on Kubernetes with LWS (#4829) · 8e7fb5d4
  Kante Yin authored May 17, 2024
```
Signed-off-by: kerthcet <kerthcet@gmail.com>
```
  8e7fb5d4
14 May, 2024 3 commits

[Bugfix][Doc] Fix CI failure in docs (#4804) · dc72402b

Cyrus Leung authored May 15, 2024

This PR fixes the CI failure introduced by #4798.

The failure originates from having duplicate target names in reST, and is fixed by changing the ref targets to anonymous ones. For more information, see this discussion.

I have also changed the format of the links to be more distinct from each other.

dc72402b

[Doc] Add meetups to the doc (#4798) · c579b750
Zhuohan Li authored May 13, 2024

c579b750
[Doc] Add API reference for offline inference (#4710) · 4bfa7e7f
Cyrus Leung authored May 14, 2024

4bfa7e7f

13 May, 2024 2 commits
- [Doc] Shorten README by removing supported model list (#4796) · ac1fbf7f
  Zhuohan Li authored May 13, 2024
  
  ac1fbf7f
- [Scheduler] Warning upon preemption and Swapping (#4647) · e7c46b95
  SangBin Cho authored May 13, 2024
```
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
```
  e7c46b95
10 May, 2024 1 commit

chunked-prefill-doc-syntax (#4603) · 51d4094f

Simon Mo authored May 09, 2024

Fix the docs: https://docs.vllm.ai/en/latest/models/performance.html

Co-authored-by: sang <rkooo567@gmail.com>

51d4094f

09 May, 2024 1 commit
- [Bugfix] Fix CLI arguments in OpenAI server docs (#4709) · a3c12457
  Cyrus Leung authored May 10, 2024
  
  a3c12457
04 May, 2024 1 commit
- [Doc] Chunked Prefill Documentation (#4580) · 36fb68f9
  SangBin Cho authored May 04, 2024
  
  36fb68f9
03 May, 2024 1 commit
- [Doc] add env vars to the doc (#4572) · 2d7bce9c
  youkaichao authored May 02, 2024
  
  2d7bce9c
01 May, 2024 2 commits
- [Doc] update(example model): for OpenAI compatible serving (#4503) · e491c7e0
  Frαnçois authored May 01, 2024
  
  e491c7e0
- Unable to find Punica extension issue during source code installation (#4494) · ee37328d
  fuchen.ljl authored May 01, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  ee37328d
30 Apr, 2024 1 commit
- [Doc] add visualization for multi-stage dockerfile (#4456) · b31a1fb6
  Prashant Gupta authored Apr 30, 2024
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  b31a1fb6
26 Apr, 2024 2 commits
- [CI] Disable non-lazy string operation on logging (#4326) · a88081bf
  SangBin Cho authored Apr 26, 2024
```
Co-authored-by: Danny Guinther <dguinther@neuralmagic.com>
```
  a88081bf
- [ROCm][Hardware][AMD][Doc] Documentation update for ROCm (#4376) · cf29b7ed
  Hongxia Yang authored Apr 25, 2024
```
Co-authored-by: WoosukKwon <woosuk.kwon@berkeley.edu>
```
  cf29b7ed
25 Apr, 2024 2 commits
- [Bugfix][Model] Refactor OLMo model to support new HF format in transformers 4.40.0 (#4324) · fbf152d9
  Isotr0py authored Apr 26, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  fbf152d9
- [Model] Adds Phi-3 support (#4298) · 96e90fde
  Caio Mendes authored Apr 25, 2024
  
  96e90fde
24 Apr, 2024 1 commit
- [Doc] Add note for docker user (#4340) · 2768884a
  youkaichao authored Apr 24, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  2768884a
23 Apr, 2024 1 commit
- Fix `autodoc` directives (#4272) · 34128a69
  Harry Mellor authored Apr 23, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  34128a69
22 Apr, 2024 2 commits
- [Doc] Update the SkyPilot doc with serving and Llama-3 (#4276) · ceaf4ed0
  Zhanghao Wu authored Apr 22, 2024
  
  ceaf4ed0
- Add example scripts to documentation (#4225) · 3d925165
  Harry Mellor authored Apr 22, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  3d925165
21 Apr, 2024 2 commits
- [Doc]: Update the doc of adding new models (#4236) · 7f2593b1
  xiaoji authored Apr 22, 2024
  
  7f2593b1
- Don't show default value for flags in `EngineArgs` (#4223) · fe7d648f
  Harry Mellor authored Apr 21, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  fe7d648f
20 Apr, 2024 1 commit
- Fix missing docs and out of sync `EngineArgs` (#4219) · 682789d4
  Harry Mellor authored Apr 20, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  682789d4
18 Apr, 2024 1 commit
- [Docs] document that Meta Llama 3 is supported (#4175) · 705578ae
  Simon Mo authored Apr 18, 2024
  
  705578ae