Commits · fd4ea8ef5c17a8b991107402a414f6ed355d854d · norm / vllm

03 Jan, 2024 1 commit
- Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221) · fd4ea8ef
  Zhuohan Li authored Jan 04, 2024
  
  fd4ea8ef
20 Dec, 2023 1 commit
- [Docs] Fix broken links (#2222) · c17daa9f
  Ronen Schaffer authored Dec 20, 2023
  
  c17daa9f
19 Dec, 2023 1 commit
- Added DeciLM-7b and DeciLM-7b-instruct (#2062) · de60a3fb
  avideci authored Dec 19, 2023
  
  de60a3fb
17 Dec, 2023 2 commits
- [Docs] Update documentation for gpu-memory-utilization option (#2162) · 3ec8c25c
  Suhong Moon authored Dec 17, 2023
  
  3ec8c25c
- [Minor] Add Phi 2 to supported models (#2159) · f8c688d7
  Woosuk Kwon authored Dec 17, 2023
  
  f8c688d7
14 Dec, 2023 1 commit
- Optimize Mixtral with expert parallelism (#2090) · 21d93c14
  Antoni Baum authored Dec 13, 2023
  
  21d93c14
13 Dec, 2023 1 commit
- [Docs] Add notes on ROCm-supported models (#2087) · 096827c2
  Woosuk Kwon authored Dec 13, 2023
  
  096827c2
11 Dec, 2023 1 commit
- Minor fixes for Mixtral (#2015) · 4ff02039
  Woosuk Kwon authored Dec 11, 2023
  
  4ff02039
06 Dec, 2023 1 commit
- Fix typo in adding_model.rst (#1947) · d940ce49
  Peter Götz authored Dec 06, 2023
```
adpated -> adapted
```
  d940ce49
01 Dec, 2023 1 commit
- Normalize head weights for Baichuan 2 (#1876) · e5452ddf
  Woosuk Kwon authored Nov 30, 2023
  
  e5452ddf
30 Nov, 2023 1 commit
- [Docs] Add information about using shared memory in docker (#1845) · 0f621c2c
  Simon Mo authored Nov 29, 2023
  
  0f621c2c
22 Nov, 2023 1 commit
- [DOCS] Add engine args documentation (#1741) · a921d8be
  Casper authored Nov 22, 2023
  
  a921d8be
18 Nov, 2023 1 commit
- Support download models from www.modelscope.cn (#1588) · edb30558
  liuyhwangyh authored Nov 18, 2023
  
  edb30558
17 Nov, 2023 1 commit
- Update the adding-model doc according to the new refactor (#1692) · 0fc280b0
  Zhuohan Li authored Nov 16, 2023
  
  0fc280b0
16 Nov, 2023 1 commit
- [Fix] Update Supported Models List (#1690) · 415d1095
  Zhuohan Li authored Nov 16, 2023
  
  415d1095
29 Sep, 2023 1 commit
- fixing typo in `tiiuae/falcon-rw-7b` model name (#1226) · 0967102c
  Usama Ahmed authored Sep 29, 2023
  
  0967102c
28 Sep, 2023 1 commit
- Add Mistral to supported model list (#1221) · 202351d5
  Woosuk Kwon authored Sep 28, 2023
  
  202351d5
05 Sep, 2023 1 commit
- Align vLLM's beam search implementation with HF generate (#857) · 002800f0
  Zhuohan Li authored Sep 04, 2023
  
  002800f0
31 Aug, 2023 1 commit

[Docs] Minor fixes in supported models (#920) · 55b28b1e

Woosuk Kwon authored Sep 01, 2023



* Minor fix in supported models

* Add another small fix for Aquila model

---------
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

55b28b1e

22 Aug, 2023 1 commit
- Update Supported Model List (#825) · 14f9c72b
  Zhuohan Li authored Aug 22, 2023
  
  14f9c72b
14 Aug, 2023 1 commit
- Fix baichuan doc style (#748) · 1b151ed1
  Uranus authored Aug 14, 2023
  
  1b151ed1
02 Aug, 2023 2 commits
- [Doc] Add Baichuan 13B to supported models (#656) · f7389f47
  Zhuohan Li authored Aug 02, 2023
  
  f7389f47
- Add Falcon support (new) (#592) · 1b0bd0fe
  Zhuohan Li authored Aug 02, 2023
  
  1b0bd0fe
25 Jul, 2023 1 commit
- Add Baichuan-7B to README (#494) · df5dd3c6
  Zhuohan Li authored Jul 25, 2023
  
  df5dd3c6
20 Jul, 2023 1 commit
- Add support for LLaMA-2 (#505) · 6fc2a38b
  Zhuohan Li authored Jul 20, 2023
  
  6fc2a38b
09 Jul, 2023 1 commit
- [Model] Add support for GPT-J (#226) · c8948361
  Andre Slavescu authored Jul 08, 2023
```
Co-authored-by: woWoosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c8948361
03 Jul, 2023 3 commits
- [Docs] Fix typo (#346) · ffa6d2f9
  Woosuk Kwon authored Jul 03, 2023
  
  ffa6d2f9
- [Model] Add support for MPT (#334) · 404422f4
  Woosuk Kwon authored Jul 03, 2023
  
  404422f4
- Add support for BLOOM (#331) · e41f0670
  Woosuk Kwon authored Jul 03, 2023
  
  e41f0670
22 Jun, 2023 1 commit
- [Docs] Add GPTBigCode to supported models (#213) · 665c4896
  Woosuk Kwon authored Jun 22, 2023
  
  665c4896
20 Jun, 2023 3 commits
- [Minor] Fix URLs (#166) · 794e578d
  Woosuk Kwon authored Jun 19, 2023
  
  794e578d
- Fix repo & documentation URLs (#163) · b7e62d34
  Woosuk Kwon authored Jun 19, 2023
  
  b7e62d34
- Add and list supported models in README (#161) · 0b32a987
  Zhuohan Li authored Jun 20, 2023
  
  0b32a987
18 Jun, 2023 1 commit
- Write README and front page of doc (#147) · dcda03b4
  Woosuk Kwon authored Jun 18, 2023
  
  dcda03b4
17 Jun, 2023 1 commit
- Change the name to vLLM (#150) · 0b98ba15
  Woosuk Kwon authored Jun 17, 2023
  
  0b98ba15
06 Jun, 2023 1 commit
- [Docs] Write the `Adding a New Model` section (#138) · 456941cf
  Woosuk Kwon authored Jun 05, 2023
  
  456941cf
03 Jun, 2023 1 commit
- Document supported models (#127) · 62ec38ea
  Woosuk Kwon authored Jun 02, 2023
  
  62ec38ea