Commits · 24f60a54f42076e0bfa49fde113756bf4e95f9ef · norm / vllm

07 Dec, 2023 2 commits
- [Docker] Adding number of nvcc_threads during build as envar (#1893) · 24f60a54
  AguirreNicolas authored Dec 07, 2023
  
  24f60a54
- Fix quickstart.rst typo jinja (#1964) · 42c02f58
  gottlike authored Dec 07, 2023
  
  42c02f58
06 Dec, 2023 1 commit
- Fix typo in adding_model.rst (#1947) · d940ce49
  Peter Götz authored Dec 06, 2023
```
adpated -> adapted
```
  d940ce49
03 Dec, 2023 2 commits
- chore(examples-docs): upgrade to OpenAI V1 (#1785) · c07a4428
  Massimiliano Pronesti authored Dec 03, 2023
  
  c07a4428
- Add Production Metrics in Prometheus format (#1890) · 5313c2cb
  Simon Mo authored Dec 02, 2023
  
  5313c2cb
02 Dec, 2023 1 commit
- [Docs] Update the AWQ documentation to highlight performance issue (#1883) · 4cefa9b4
  Simon Mo authored Dec 02, 2023
  
  4cefa9b4
01 Dec, 2023 2 commits
- Normalize head weights for Baichuan 2 (#1876) · e5452ddf
  Woosuk Kwon authored Nov 30, 2023
  
  e5452ddf
- Support chat template and `echo` for chat API (#1756) · 66785cc0
  Adam Brusselback authored Nov 30, 2023
  
  66785cc0
30 Nov, 2023 2 commits
- docs: add instruction for langchain (#1162) · 05a38612
  Massimiliano Pronesti authored Nov 30, 2023
  
  05a38612
- [Docs] Add information about using shared memory in docker (#1845) · 0f621c2c
  Simon Mo authored Nov 29, 2023
  
  0f621c2c
22 Nov, 2023 1 commit
- [DOCS] Add engine args documentation (#1741) · a921d8be
  Casper authored Nov 22, 2023
  
  a921d8be
20 Nov, 2023 2 commits
- [Docs] Fix the code block's format in deploying_with_docker page (#1722) · 112627e8
  Wen Sun authored Nov 20, 2023
  
  112627e8
- Documentation about official docker image (#1709) · 37c1e3c2
  Simon Mo authored Nov 19, 2023
  
  37c1e3c2
19 Nov, 2023 1 commit
- Add instructions to install vLLM+cu118 (#1717) · 06e9ebeb
  Woosuk Kwon authored Nov 18, 2023
  
  06e9ebeb
18 Nov, 2023 1 commit
- Support download models from www.modelscope.cn (#1588) · edb30558
  liuyhwangyh authored Nov 18, 2023
  
  edb30558
17 Nov, 2023 1 commit
- Update the adding-model doc according to the new refactor (#1692) · 0fc280b0
  Zhuohan Li authored Nov 16, 2023
  
  0fc280b0
16 Nov, 2023 1 commit
- [Fix] Update Supported Models List (#1690) · 415d1095
  Zhuohan Li authored Nov 16, 2023
  
  415d1095
05 Nov, 2023 1 commit
- Add Quantization and AutoAWQ to docs (#1235) · 85169994
  Casper authored Nov 05, 2023
  
  85169994
31 Oct, 2023 1 commit
- Add Dockerfile (#1350) · 9cabcb76
  Stephen Krider authored Oct 31, 2023
  
  9cabcb76
09 Oct, 2023 1 commit
- Update README.md (#1292) · 9eed4d1f
  Zhuohan Li authored Oct 08, 2023
  
  9eed4d1f
29 Sep, 2023 1 commit
- fixing typo in `tiiuae/falcon-rw-7b` model name (#1226) · 0967102c
  Usama Ahmed authored Sep 29, 2023
  
  0967102c
28 Sep, 2023 1 commit
- Add Mistral to supported model list (#1221) · 202351d5
  Woosuk Kwon authored Sep 28, 2023
  
  202351d5
22 Sep, 2023 2 commits
- Docs: Fix broken link to openai example (#1145) · 4ee52bb1
  Nick Perez authored Sep 22, 2023
```
Link to `openai_client.py` is no longer valid - updated to `openai_completion_client.py`
```
  4ee52bb1
- Use `--ipc=host` in docker run for distributed inference (#1125) · 7d7e3b78
  Woosuk Kwon authored Sep 21, 2023
  
  7d7e3b78
20 Sep, 2023 1 commit
- Add documentation to Triton server tutorial (#983) · 6f2dd6c3
  Tanmay Verma authored Sep 20, 2023
  
  6f2dd6c3
14 Sep, 2023 1 commit
- Announce paper release (#1036) · eda1a7ca
  Woosuk Kwon authored Sep 13, 2023
  
  eda1a7ca
10 Sep, 2023 1 commit
- [Docs] Update installation page (#1005) · b9cecc26
  Woosuk Kwon authored Sep 10, 2023
  
  b9cecc26
05 Sep, 2023 1 commit
- Align vLLM's beam search implementation with HF generate (#857) · 002800f0
  Zhuohan Li authored Sep 04, 2023
  
  002800f0
31 Aug, 2023 1 commit

[Docs] Minor fixes in supported models (#920) · 55b28b1e

Woosuk Kwon authored Sep 01, 2023



* Minor fix in supported models

* Add another small fix for Aquila model

---------
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

55b28b1e

22 Aug, 2023 1 commit
- Update Supported Model List (#825) · 14f9c72b
  Zhuohan Li authored Aug 22, 2023
  
  14f9c72b
14 Aug, 2023 1 commit
- Fix baichuan doc style (#748) · 1b151ed1
  Uranus authored Aug 14, 2023
  
  1b151ed1
02 Aug, 2023 2 commits
- [Doc] Add Baichuan 13B to supported models (#656) · f7389f47
  Zhuohan Li authored Aug 02, 2023
  
  f7389f47
- Add Falcon support (new) (#592) · 1b0bd0fe
  Zhuohan Li authored Aug 02, 2023
  
  1b0bd0fe
25 Jul, 2023 1 commit
- Add Baichuan-7B to README (#494) · df5dd3c6
  Zhuohan Li authored Jul 25, 2023
  
  df5dd3c6
20 Jul, 2023 1 commit
- Add support for LLaMA-2 (#505) · 6fc2a38b
  Zhuohan Li authored Jul 20, 2023
  
  6fc2a38b
16 Jul, 2023 1 commit
- [Doc] Add doc for running vLLM on the cloud (#426) · 58df2883
  Zhanghao Wu authored Jul 16, 2023
```
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
```
  58df2883
09 Jul, 2023 1 commit
- [Model] Add support for GPT-J (#226) · c8948361
  Andre Slavescu authored Jul 08, 2023
```
Co-authored-by: woWoosuk Kwon <woosuk.kwon@berkeley.edu>
```
  c8948361
03 Jul, 2023 3 commits
- [Docs] Fix typo (#346) · ffa6d2f9
  Woosuk Kwon authored Jul 03, 2023
  
  ffa6d2f9
- [Model] Add support for MPT (#334) · 404422f4
  Woosuk Kwon authored Jul 03, 2023
  
  404422f4
- Add support for BLOOM (#331) · e41f0670
  Woosuk Kwon authored Jul 03, 2023
  
  e41f0670