Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "5ea844964e4a59eef8a3162dc0f2e54c16bbb6e2"
Commit 0e18f7c0 authored by laibao's avatar laibao
Browse files

更新镜像，更新环境变量(包含绑卡顺序，同流推理）

parent 3c596961
Show whitespace changes
Inline Side-by-side
Showing with 12 additions and 10 deletions
README.md
View file @ 0e18f7c0
...@@ -77,6 +77,7 @@ conda create -n llava_vllm python=3.10 ...@@ -77,6 +77,7 @@ conda create -n llava_vllm python=3.10
* python: python3.10 * python: python3.10
`Tips：需先安装相关依赖，最后安装vllm包` `Tips：需先安装相关依赖，最后安装vllm包`
环境变量： 环境变量：
export ALLREDUCE_STREAM_WITH_COMPUTE=1 export ALLREDUCE_STREAM_WITH_COMPUTE=1
export VLLM_RANK0_NUMA=0 export VLLM_RANK0_NUMA=0
...@@ -90,6 +91,7 @@ export VLLM_RANK7_NUMA=7 ...@@ -90,6 +91,7 @@ export VLLM_RANK7_NUMA=7
## 数据集 ## 数据集
无 无
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment