Skip to content

GitLab

Commit 22f41336 authored by laibao's avatar laibao
Browse files

Update README.md

parent d74ad4b8
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
README.md
View file @ 22f41336
...@@ -58,7 +58,8 @@ conda create -n llama_vllm python=3.10 ...@@ -58,7 +58,8 @@ conda create -n llama_vllm python=3.10
* vllm: 0.6.2 * vllm: 0.6.2
* python: python3.10 * python: python3.10
`Tips：需先安装相关依赖，最后安装vllm包` `Tips：需先安装相关依赖，最后安装vllm包`
环境变量： 环境变量：
export ALLREDUCE_STREAM_WITH_COMPUTE=1 export ALLREDUCE_STREAM_WITH_COMPUTE=1
export VLLM_NUMA_BIND=1 export VLLM_NUMA_BIND=1
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment