Commits · fd4ea8ef5c17a8b991107402a414f6ed355d854d · norm / vllm

03 Jan, 2024 1 commit
- Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221) · fd4ea8ef
  Zhuohan Li authored Jan 04, 2024
  
  fd4ea8ef
23 Dec, 2023 1 commit
- [Docs] Update installation instructions to include CUDA 11.8 xFormers (#2246) · 1db83e31
  Shivam Thakkar authored Dec 23, 2023
  
  1db83e31
20 Dec, 2023 1 commit
- [Docs] Fix broken links (#2222) · c17daa9f
  Ronen Schaffer authored Dec 20, 2023
  
  c17daa9f
19 Dec, 2023 1 commit
- Added DeciLM-7b and DeciLM-7b-instruct (#2062) · de60a3fb
  avideci authored Dec 19, 2023
  
  de60a3fb
18 Dec, 2023 1 commit
- [ROCm] Fixes for GPTQ on ROCm (#2180) · 1b7c791d
  kliuae authored Dec 19, 2023
  
  1b7c791d
17 Dec, 2023 3 commits
- [Docs] Update documentation for gpu-memory-utilization option (#2162) · 3ec8c25c
  Suhong Moon authored Dec 17, 2023
  
  3ec8c25c
- [Minor] Add Phi 2 to supported models (#2159) · f8c688d7
  Woosuk Kwon authored Dec 17, 2023
  
  f8c688d7
- [Docs] Add CUDA graph support to docs (#2148) · 26c52a5e
  Woosuk Kwon authored Dec 17, 2023
  
  26c52a5e
15 Dec, 2023 1 commit
- [Docs] Add supported quantization methods to docs (#2135) · b81a6a6b
  Woosuk Kwon authored Dec 15, 2023
  
  b81a6a6b
14 Dec, 2023 1 commit
- Optimize Mixtral with expert parallelism (#2090) · 21d93c14
  Antoni Baum authored Dec 13, 2023
  
  21d93c14
13 Dec, 2023 3 commits
- [Docs] Add notes on ROCm-supported models (#2087) · 096827c2
  Woosuk Kwon authored Dec 13, 2023
  
  096827c2
- Update installation instruction for vLLM + CUDA 11.8 (#2086) · 6565d9e3
  Woosuk Kwon authored Dec 13, 2023
  
  6565d9e3
- [ROCm] Upgrade xformers version for ROCm & update doc (#2079) · f375ec84
  TJian authored Dec 13, 2023
```
Co-authored-by: miloice <jeffaw99@hotmail.com>
```
  f375ec84
11 Dec, 2023 2 commits
- Update run_on_sky.rst (#2025) · c0ce15df
  Ikko Eltociear Ashimine authored Dec 12, 2023
```
sharable -> shareable
```
  c0ce15df
- Minor fixes for Mixtral (#2015) · 4ff02039
  Woosuk Kwon authored Dec 11, 2023
  
  4ff02039
08 Dec, 2023 2 commits

[Docker] Add cuda arch list as build option (#1950) · c85b80c2
Simon Mo authored Dec 08, 2023

c85b80c2

Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836) · 6ccc0bff

TJian authored Dec 08, 2023


Co-authored-by: Philipp Moritz <pcmoritz@gmail.com>
Co-authored-by: Amir Balwel <amoooori04@gmail.com>
Co-authored-by: root <kuanfu.liu@akirakan.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: kuanfu <kuanfu.liu@embeddedllm.com>
Co-authored-by: miloice <17350011+kliuae@users.noreply.github.com>

6ccc0bff

07 Dec, 2023 2 commits
- [Docker] Adding number of nvcc_threads during build as envar (#1893) · 24f60a54
  AguirreNicolas authored Dec 07, 2023
  
  24f60a54
- Fix quickstart.rst typo jinja (#1964) · 42c02f58
  gottlike authored Dec 07, 2023
  
  42c02f58
06 Dec, 2023 1 commit
- Fix typo in adding_model.rst (#1947) · d940ce49
  Peter Götz authored Dec 06, 2023
```
adpated -> adapted
```
  d940ce49
03 Dec, 2023 2 commits
- chore(examples-docs): upgrade to OpenAI V1 (#1785) · c07a4428
  Massimiliano Pronesti authored Dec 03, 2023
  
  c07a4428
- Add Production Metrics in Prometheus format (#1890) · 5313c2cb
  Simon Mo authored Dec 02, 2023
  
  5313c2cb
02 Dec, 2023 1 commit
- [Docs] Update the AWQ documentation to highlight performance issue (#1883) · 4cefa9b4
  Simon Mo authored Dec 02, 2023
  
  4cefa9b4
01 Dec, 2023 2 commits
- Normalize head weights for Baichuan 2 (#1876) · e5452ddf
  Woosuk Kwon authored Nov 30, 2023
  
  e5452ddf
- Support chat template and `echo` for chat API (#1756) · 66785cc0
  Adam Brusselback authored Nov 30, 2023
  
  66785cc0
30 Nov, 2023 2 commits
- docs: add instruction for langchain (#1162) · 05a38612
  Massimiliano Pronesti authored Nov 30, 2023
  
  05a38612
- [Docs] Add information about using shared memory in docker (#1845) · 0f621c2c
  Simon Mo authored Nov 29, 2023
  
  0f621c2c
22 Nov, 2023 1 commit
- [DOCS] Add engine args documentation (#1741) · a921d8be
  Casper authored Nov 22, 2023
  
  a921d8be
20 Nov, 2023 2 commits
- [Docs] Fix the code block's format in deploying_with_docker page (#1722) · 112627e8
  Wen Sun authored Nov 20, 2023
  
  112627e8
- Documentation about official docker image (#1709) · 37c1e3c2
  Simon Mo authored Nov 19, 2023
  
  37c1e3c2
19 Nov, 2023 1 commit
- Add instructions to install vLLM+cu118 (#1717) · 06e9ebeb
  Woosuk Kwon authored Nov 18, 2023
  
  06e9ebeb
18 Nov, 2023 1 commit
- Support download models from www.modelscope.cn (#1588) · edb30558
  liuyhwangyh authored Nov 18, 2023
  
  edb30558
17 Nov, 2023 1 commit
- Update the adding-model doc according to the new refactor (#1692) · 0fc280b0
  Zhuohan Li authored Nov 16, 2023
  
  0fc280b0
16 Nov, 2023 1 commit
- [Fix] Update Supported Models List (#1690) · 415d1095
  Zhuohan Li authored Nov 16, 2023
  
  415d1095
05 Nov, 2023 1 commit
- Add Quantization and AutoAWQ to docs (#1235) · 85169994
  Casper authored Nov 05, 2023
  
  85169994
31 Oct, 2023 1 commit
- Add Dockerfile (#1350) · 9cabcb76
  Stephen Krider authored Oct 31, 2023
  
  9cabcb76
09 Oct, 2023 1 commit
- Update README.md (#1292) · 9eed4d1f
  Zhuohan Li authored Oct 08, 2023
  
  9eed4d1f
29 Sep, 2023 1 commit
- fixing typo in `tiiuae/falcon-rw-7b` model name (#1226) · 0967102c
  Usama Ahmed authored Sep 29, 2023
  
  0967102c
28 Sep, 2023 1 commit
- Add Mistral to supported model list (#1221) · 202351d5
  Woosuk Kwon authored Sep 28, 2023
  
  202351d5
22 Sep, 2023 1 commit
- Docs: Fix broken link to openai example (#1145) · 4ee52bb1
  Nick Perez authored Sep 22, 2023
```
Link to `openai_client.py` is no longer valid - updated to `openai_completion_client.py`
```
  4ee52bb1