Skip to content

GitLab

Commit e2493031 authored by luopl's avatar luopl
Browse files

add the K100 AI inference method

parent cb168f56
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
README.md
View file @ e2493031
...@@ -111,6 +111,8 @@ ray start --address='x.x.x.x:6379' --num-gpus=8 --num-cpus=32 ...@@ -111,6 +111,8 @@ ray start --address='x.x.x.x:6379' --num-gpus=8 --num-cpus=32
3. 启动vllm server 3. 启动vllm server
** 注意**：使用K100 AI 集群启动服务时需要添加**--disable-custom-all-reduce**参数
```bash ```bash
## serve启动 ## serve启动
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment