Commits · d79d9eaaff90801668613a4e3d5d8a0004963f21 · OpenDAS / vllm_cscc

29 May, 2024 1 commit
- [Doc][Build] update after removing vllm-nccl (#5103) · 4fbcb0f2
  youkaichao authored May 29, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  4fbcb0f2
28 May, 2024 2 commits
- [Core] Consolidate prompt arguments to LLM engines (#4328) · 5ae5ed1e
  Cyrus Leung authored May 29, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  5ae5ed1e
- [Docs] Add Dropbox as sponsors (#5089) · 290f4ada
  Simon Mo authored May 28, 2024
  
  290f4ada
25 May, 2024 1 commit

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) · 8e192ff9

Eric Xihui Lin authored May 25, 2024


Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

8e192ff9

23 May, 2024 1 commit
- [Doc] add ccache guide in doc (#5012) · 6a50f4ca
  youkaichao authored May 23, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  6a50f4ca
21 May, 2024 2 commits
- [Docs] Add acknowledgment for sponsors (#4925) · e941f885
  Simon Mo authored May 21, 2024
  
  e941f885
- [Model] Add Phi-2 LoRA support (#4886) · f12c3b5b
  Isotr0py authored May 21, 2024
  
  f12c3b5b
16 May, 2024 1 commit
- Support to serve vLLM on Kubernetes with LWS (#4829) · 8e7fb5d4
  Kante Yin authored May 17, 2024
```
Signed-off-by: kerthcet <kerthcet@gmail.com>
```
  8e7fb5d4
14 May, 2024 3 commits

[Bugfix][Doc] Fix CI failure in docs (#4804) · dc72402b

Cyrus Leung authored May 15, 2024

This PR fixes the CI failure introduced by #4798.

The failure originates from having duplicate target names in reST, and is fixed by changing the ref targets to anonymous ones. For more information, see this discussion.

I have also changed the format of the links to be more distinct from each other.

dc72402b

[Doc] Add meetups to the doc (#4798) · c579b750
Zhuohan Li authored May 13, 2024

c579b750
[Doc] Add API reference for offline inference (#4710) · 4bfa7e7f
Cyrus Leung authored May 14, 2024

4bfa7e7f

13 May, 2024 2 commits
- [Doc] Shorten README by removing supported model list (#4796) · ac1fbf7f
  Zhuohan Li authored May 13, 2024
  
  ac1fbf7f
- [Scheduler] Warning upon preemption and Swapping (#4647) · e7c46b95
  SangBin Cho authored May 13, 2024
```
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>
```
  e7c46b95
10 May, 2024 2 commits
- [Bugfix] Fix CLI arguments in OpenAI server docs (#4729) · 706588a7
  Allen.Dou authored May 10, 2024
  
  706588a7
- chunked-prefill-doc-syntax (#4603) · 51d4094f
  Simon Mo authored May 09, 2024
```
Fix the docs: https://docs.vllm.ai/en/latest/models/performance.html

Co-authored-by: sang <rkooo567@gmail.com>
```
  51d4094f
09 May, 2024 1 commit
- [Bugfix] Fix CLI arguments in OpenAI server docs (#4709) · a3c12457
  Cyrus Leung authored May 10, 2024
  
  a3c12457
04 May, 2024 1 commit
- [Doc] Chunked Prefill Documentation (#4580) · 36fb68f9
  SangBin Cho authored May 04, 2024
  
  36fb68f9
03 May, 2024 1 commit
- [Doc] add env vars to the doc (#4572) · 2d7bce9c
  youkaichao authored May 02, 2024
  
  2d7bce9c
01 May, 2024 2 commits
- [Doc] update(example model): for OpenAI compatible serving (#4503) · e491c7e0
  Frαnçois authored May 01, 2024
  
  e491c7e0
- Unable to find Punica extension issue during source code installation (#4494) · ee37328d
  fuchen.ljl authored May 01, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  ee37328d
30 Apr, 2024 1 commit
- [Doc] add visualization for multi-stage dockerfile (#4456) · b31a1fb6
  Prashant Gupta authored Apr 30, 2024
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  b31a1fb6
26 Apr, 2024 2 commits
- [CI] Disable non-lazy string operation on logging (#4326) · a88081bf
  SangBin Cho authored Apr 26, 2024
```
Co-authored-by: Danny Guinther <dguinther@neuralmagic.com>
```
  a88081bf
- [ROCm][Hardware][AMD][Doc] Documentation update for ROCm (#4376) · cf29b7ed
  Hongxia Yang authored Apr 25, 2024
```
Co-authored-by: WoosukKwon <woosuk.kwon@berkeley.edu>
```
  cf29b7ed
25 Apr, 2024 2 commits
- [Bugfix][Model] Refactor OLMo model to support new HF format in transformers 4.40.0 (#4324) · fbf152d9
  Isotr0py authored Apr 26, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  fbf152d9
- [Model] Adds Phi-3 support (#4298) · 96e90fde
  Caio Mendes authored Apr 25, 2024
  
  96e90fde
24 Apr, 2024 1 commit
- [Doc] Add note for docker user (#4340) · 2768884a
  youkaichao authored Apr 24, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  2768884a
23 Apr, 2024 1 commit
- Fix `autodoc` directives (#4272) · 34128a69
  Harry Mellor authored Apr 23, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  34128a69
22 Apr, 2024 2 commits
- [Doc] Update the SkyPilot doc with serving and Llama-3 (#4276) · ceaf4ed0
  Zhanghao Wu authored Apr 22, 2024
  
  ceaf4ed0
- Add example scripts to documentation (#4225) · 3d925165
  Harry Mellor authored Apr 22, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  3d925165
21 Apr, 2024 2 commits
- [Doc]: Update the doc of adding new models (#4236) · 7f2593b1
  xiaoji authored Apr 22, 2024
  
  7f2593b1
- Don't show default value for flags in `EngineArgs` (#4223) · fe7d648f
  Harry Mellor authored Apr 21, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  fe7d648f
20 Apr, 2024 1 commit
- Fix missing docs and out of sync `EngineArgs` (#4219) · 682789d4
  Harry Mellor authored Apr 20, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  682789d4
18 Apr, 2024 1 commit
- [Docs] document that Meta Llama 3 is supported (#4175) · 705578ae
  Simon Mo authored Apr 18, 2024
  
  705578ae
15 Apr, 2024 1 commit
- [Doc] Add better clarity for tensorizer usage (#4090) · d619ae2d
  Sanger Steel authored Apr 15, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  d619ae2d
14 Apr, 2024 2 commits
- [Docs] document that mixtral 8x22b is supported (#4073) · aceb17cf
  Simon Mo authored Apr 14, 2024
  
  aceb17cf
- [Frontend] [Core] feat: Add model loading using `tensorizer` (#3476) · 711a0002
  Sanger Steel authored Apr 13, 2024
  
  711a0002
12 Apr, 2024 1 commit
- [Doc] Add typing hints / mypy types cleanup (#3816) · c2b4a1bc
  Michael Feil authored Apr 11, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  c2b4a1bc
11 Apr, 2024 1 commit
- [Doc][Installation] delete python setup.py develop (#3989) · f3d0bf75
  youkaichao authored Apr 10, 2024
  
  f3d0bf75
10 Apr, 2024 2 commits
- [Doc] Fix getting stared to use publicly available model (#3963) · 92cd2e2f
  Frαnçois authored Apr 10, 2024
  
  92cd2e2f
- [Doc] Add doc to state our model support policy (#3948) · e3539746
  youkaichao authored Apr 10, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  e3539746