Skip to content

GitLab

"docs/vscode:/vscode.git/clone" did not exist on "491237aa16df209a1601e7de0e4036dc4d2ce811"
Unverified Commit 6565d9e3 authored by Woosuk Kwon's avatar Woosuk Kwon Committed by GitHub
Browse files

Update installation instruction for vLLM + CUDA 11.8 (#2086)

parent f375ec84
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 3 deletions
docs/source/getting_started/installation.rst
View file @ 6565d9e3
...@@ -20,7 +20,7 @@ You can install vLLM using pip: ...@@ -20,7 +20,7 @@ You can install vLLM using pip:
.. code-block:: console .. code-block:: console
$ # (Optional) Create a new conda environment. $ # (Optional) Create a new conda environment.
$ conda create -n myenv python=3.8 -y $ conda create -n myenv python=3.9 -y
$ conda activate myenv $ conda activate myenv
$ # Install vLLM with CUDA 12.1. $ # Install vLLM with CUDA 12.1.
...@@ -34,8 +34,9 @@ You can install vLLM using pip: ...@@ -34,8 +34,9 @@ You can install vLLM using pip:
.. code-block:: console .. code-block:: console
$ # Install vLLM with CUDA 11.8. $ # Install vLLM with CUDA 11.8.
$ # Replace `cp310` with your Python version (e.g., `cp38`, `cp39`, `cp311`). $ export VLLM_VERSION=0.2.4
$ pip install https://github.com/vllm-project/vllm/releases/download/v0.2.2/vllm-0.2.2+cu118-cp310-cp310-manylinux1_x86_64.whl $ export PYTHON_VERSION=39
$ pip install https://github.com/vllm-project/vllm/releases/download/v${VLLM_VERSION}/vllm-${VLLM_VERSION}+cu118-cp${PYTHON_VERSION}-cp${PYTHON_VERSION}-manylinux1_x86_64.whl
$ # Re-install PyTorch with CUDA 11.8. $ # Re-install PyTorch with CUDA 11.8.
$ pip uninstall torch -y $ pip uninstall torch -y
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment