Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
8c00f9c1
Unverified
Commit
8c00f9c1
authored
Jun 21, 2024
by
Woosuk Kwon
Committed by
GitHub
Jun 21, 2024
Browse files
[Docs][TPU] Add installation tip for TPU (#5761)
parent
0cbc1d2b
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
18 additions
and
0 deletions
+18
-0
docs/source/getting_started/tpu-installation.rst
docs/source/getting_started/tpu-installation.rst
+18
-0
No files found.
docs/source/getting_started/tpu-installation.rst
View file @
8c00f9c1
...
@@ -73,3 +73,21 @@ Next, build vLLM from source. This will only take a few seconds:
...
@@ -73,3 +73,21 @@ Next, build vLLM from source. This will only take a few seconds:
.. code-block:: console
.. code-block:: console
$ VLLM_TARGET_DEVICE="tpu" python setup.py develop
$ VLLM_TARGET_DEVICE="tpu" python setup.py develop
.. tip::
If you encounter the following error:
.. code-block:: console
from torch._C import * # noqa: F403
ImportError: libopenblas.so.0: cannot open shared object file: No such file or directory
You can install OpenBLAS with the following command:
.. code-block:: console
$ sudo apt-get install libopenblas-base libopenmpi-dev libomp-dev
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment