Skip to content

GitLab

Commit 770cdd2f authored by weishb's avatar weishb
Browse files

support k100ai

parent 4395d9f5
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ 770cdd2f
...@@ -65,7 +65,7 @@ docker run -it \ ...@@ -65,7 +65,7 @@ docker run -it \
## vllm ## vllm
#### 单机推理 #### 单机推理
注意：使用K100 AI 启动服务时需要添加--disable-custom-all-reduce参数
```bash ```bash
## serve启动 ## serve启动
export HF_HUB_OFFLINE=1 export HF_HUB_OFFLINE=1
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment