Commits · 36fb68f94792a8cec8df5b58bab7ab4d4d6158b4 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "cd9c0d65d98f86fbd2235ee41b80107097a57f77"

04 May, 2024 1 commit
- [Doc] Chunked Prefill Documentation (#4580) · 36fb68f9
  SangBin Cho authored May 04, 2024
  
  36fb68f9
03 May, 2024 1 commit
- [Doc] add env vars to the doc (#4572) · 2d7bce9c
  youkaichao authored May 02, 2024
  
  2d7bce9c
01 May, 2024 2 commits
- [Doc] update(example model): for OpenAI compatible serving (#4503) · e491c7e0
  Frαnçois authored May 01, 2024
  
  e491c7e0
- Unable to find Punica extension issue during source code installation (#4494) · ee37328d
  fuchen.ljl authored May 01, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  ee37328d
30 Apr, 2024 1 commit
- [Doc] add visualization for multi-stage dockerfile (#4456) · b31a1fb6
  Prashant Gupta authored Apr 30, 2024
```
Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  b31a1fb6
26 Apr, 2024 2 commits
- [CI] Disable non-lazy string operation on logging (#4326) · a88081bf
  SangBin Cho authored Apr 26, 2024
```
Co-authored-by: Danny Guinther <dguinther@neuralmagic.com>
```
  a88081bf
- [ROCm][Hardware][AMD][Doc] Documentation update for ROCm (#4376) · cf29b7ed
  Hongxia Yang authored Apr 25, 2024
```
Co-authored-by: WoosukKwon <woosuk.kwon@berkeley.edu>
```
  cf29b7ed
25 Apr, 2024 2 commits
- [Bugfix][Model] Refactor OLMo model to support new HF format in transformers 4.40.0 (#4324) · fbf152d9
  Isotr0py authored Apr 26, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  fbf152d9
- [Model] Adds Phi-3 support (#4298) · 96e90fde
  Caio Mendes authored Apr 25, 2024
  
  96e90fde
24 Apr, 2024 1 commit
- [Doc] Add note for docker user (#4340) · 2768884a
  youkaichao authored Apr 24, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  2768884a
23 Apr, 2024 1 commit
- Fix `autodoc` directives (#4272) · 34128a69
  Harry Mellor authored Apr 23, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  34128a69
22 Apr, 2024 2 commits
- [Doc] Update the SkyPilot doc with serving and Llama-3 (#4276) · ceaf4ed0
  Zhanghao Wu authored Apr 22, 2024
  
  ceaf4ed0
- Add example scripts to documentation (#4225) · 3d925165
  Harry Mellor authored Apr 22, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  3d925165
21 Apr, 2024 2 commits
- [Doc]: Update the doc of adding new models (#4236) · 7f2593b1
  xiaoji authored Apr 22, 2024
  
  7f2593b1
- Don't show default value for flags in `EngineArgs` (#4223) · fe7d648f
  Harry Mellor authored Apr 21, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  fe7d648f
20 Apr, 2024 1 commit
- Fix missing docs and out of sync `EngineArgs` (#4219) · 682789d4
  Harry Mellor authored Apr 20, 2024
```
Co-authored-by: Harry Mellor <hmellor@oxts.com>
```
  682789d4
18 Apr, 2024 1 commit
- [Docs] document that Meta Llama 3 is supported (#4175) · 705578ae
  Simon Mo authored Apr 18, 2024
  
  705578ae
15 Apr, 2024 1 commit
- [Doc] Add better clarity for tensorizer usage (#4090) · d619ae2d
  Sanger Steel authored Apr 15, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  d619ae2d
14 Apr, 2024 2 commits
- [Docs] document that mixtral 8x22b is supported (#4073) · aceb17cf
  Simon Mo authored Apr 14, 2024
  
  aceb17cf
- [Frontend] [Core] feat: Add model loading using `tensorizer` (#3476) · 711a0002
  Sanger Steel authored Apr 13, 2024
  
  711a0002
12 Apr, 2024 1 commit
- [Doc] Add typing hints / mypy types cleanup (#3816) · c2b4a1bc
  Michael Feil authored Apr 11, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  c2b4a1bc
11 Apr, 2024 1 commit
- [Doc][Installation] delete python setup.py develop (#3989) · f3d0bf75
  youkaichao authored Apr 10, 2024
  
  f3d0bf75
10 Apr, 2024 2 commits
- [Doc] Fix getting stared to use publicly available model (#3963) · 92cd2e2f
  Frαnçois authored Apr 10, 2024
  
  92cd2e2f
- [Doc] Add doc to state our model support policy (#3948) · e3539746
  youkaichao authored Apr 10, 2024
```
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  e3539746
08 Apr, 2024 1 commit
- [Model] add minicpm (#3893) · b4543c8f
  ywfang authored Apr 08, 2024
  
  b4543c8f
07 Apr, 2024 1 commit
- [Core] enable out-of-tree model register (#3871) · 95baec82
  youkaichao authored Apr 06, 2024
  
  95baec82
05 Apr, 2024 2 commits
- [CI/Build] refactor dockerfile & fix pip cache · d03d64fd
  youkaichao authored Apr 04, 2024
```
[CI/Build] fix pip cache with vllm_nccl & refactor dockerfile to build wheels (#3859)
```
  d03d64fd
- [Doc]Add asynchronous engine arguments to documentation. (#3810) · 78107fa0
  Sean Gallen authored Apr 04, 2024
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  78107fa0
03 Apr, 2024 1 commit

Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (#3290) · 2ff767b5

Adrian Abeyta authored Apr 03, 2024


Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: AdrianAbeyta <Adrian.Abeyta@amd.com>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: root <root@gt-pla-u18-08.pla.dcgpu>
Co-authored-by: mawong-amd <156021403+mawong-amd@users.noreply.github.com>
Co-authored-by: ttbachyinsda <ttbachyinsda@outlook.com>
Co-authored-by: guofangze <guofangze@kuaishou.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: jacobthebanana <50071502+jacobthebanana@users.noreply.github.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

2ff767b5

02 Apr, 2024 2 commits
- [Doc] Fix vLLMEngine Doc Page (#3791) · 3bec41f4
  Roger Wang authored Apr 02, 2024
  
  3bec41f4
- [Hardware][Intel] Add CPU inference backend (#3634) · 0e3f06fe
  bigPYJ1151 authored Apr 02, 2024
```
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yuan Zhou <yuan.zhou@intel.com>
```
  0e3f06fe
30 Mar, 2024 1 commit

[Doc] Update installation doc (#3746) · 9c82a1be

youkaichao authored Mar 30, 2024



[Doc] Update installation doc for build from source and explain the dependency on torch/cuda version (#3746)
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

9c82a1be

29 Mar, 2024 1 commit
- Usage Stats Collection (#2852) · d8658c8c
  yhu422 authored Mar 28, 2024
  
  d8658c8c
28 Mar, 2024 1 commit
- [Model] Add support for Qwen2MoeModel (#3346) · d6ea427f
  wenyujin333 authored Mar 28, 2024
  
  d6ea427f
27 Mar, 2024 4 commits
- [Docs] Add Command-R to supported models (#3669) · 6d9aa00f
  Woosuk Kwon authored Mar 27, 2024
  
  6d9aa00f
- [Model] Add support for DBRX (#3660) · e24336b5
  Megha Agarwal authored Mar 27, 2024
  
  e24336b5
- [Misc] Minor fix in KVCache type (#3652) · e66b629c
  Woosuk Kwon authored Mar 26, 2024
  
  e66b629c
- [Doc]add lora support (#3649) · 76879342
  Jee Li authored Mar 27, 2024
  
  76879342
25 Mar, 2024 2 commits
- [CI] Try introducing isort. (#3495) · 01bfb22b
  SangBin Cho authored Mar 25, 2024
  
  01bfb22b
- [CI/Build] respect the common environment variable MAX_JOBS (#3600) · 42bc3861
  youkaichao authored Mar 24, 2024
  
  42bc3861