Skip to content

GitLab

Commit babb4058 authored by luopl's avatar luopl
Browse files

add K100 AI method

parent 0c9be906
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
README.md
View file @ babb4058
...@@ -111,7 +111,7 @@ ray start --address='x.x.x.x:6379' --num-gpus=8 --num-cpus=32 ...@@ -111,7 +111,7 @@ ray start --address='x.x.x.x:6379' --num-gpus=8 --num-cpus=32
3. 启动vllm server 3. 启动vllm server
**注意**：使用K100 AI 集群启动服务时需要添加**--disable-custom-all-reduce**参数 **注意**：使用`K100 AI` 集群启动服务时需要添加`--disable-custom-all-reduce`参数
```bash ```bash
## serve启动 ## serve启动
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment