Unverified Commit 3c301239 authored by omrishiv's avatar omrishiv Committed by GitHub
Browse files

[Doc] add VLLM_TARGET_DEVICE=neuron to documentation for neuron (#6844)


Signed-off-by: default avataromrishiv <327609+omrishiv@users.noreply.github.com>
parent ced36cd8
......@@ -131,6 +131,6 @@ Once neuronx-cc and transformers-neuronx packages are installed, we will be able
$ git clone https://github.com/vllm-project/vllm.git
$ cd vllm
$ pip install -U -r requirements-neuron.txt
$ pip install .
$ VLLM_TARGET_DEVICE="neuron" pip install .
If neuron packages are detected correctly in the installation process, ``vllm-0.3.0+neuron212`` will be installed.
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment