Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
norm
vllm
Commits
1db83e31
Unverified
Commit
1db83e31
authored
Dec 23, 2023
by
Shivam Thakkar
Committed by
GitHub
Dec 22, 2023
Browse files
[Docs] Update installation instructions to include CUDA 11.8 xFormers (#2246)
parent
a1b9cb2a
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
0 deletions
+4
-0
docs/source/getting_started/installation.rst
docs/source/getting_started/installation.rst
+4
-0
No files found.
docs/source/getting_started/installation.rst
View file @
1db83e31
...
@@ -42,6 +42,10 @@ You can install vLLM using pip:
...
@@ -42,6 +42,10 @@ You can install vLLM using pip:
$ pip uninstall torch -y
$ pip uninstall torch -y
$ pip install torch --upgrade --index-url https://download.pytorch.org/whl/cu118
$ pip install torch --upgrade --index-url https://download.pytorch.org/whl/cu118
$ # Re-install xFormers with CUDA 11.8.
$ pip uninstall xformers -y
$ pip install --upgrade xformers --index-url https://download.pytorch.org/whl/cu118
.. _build_from_source:
.. _build_from_source:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment