"...composable_kernel_onnxruntime.git" did not exist on "abf9cc6c5cdb9b3b6f2e8ed25feebbacab59d198"
Unverified Commit d6331154 authored by MissPenguin's avatar MissPenguin Committed by GitHub
Browse files

Update serving.md

parent 757fed1d
......@@ -96,6 +96,7 @@ $ hub serving start --modules [Module1==Version1, Module2==Version2, ...] \
**注意:**
- 使用配置文件启动服务时,其他参数会被忽略。
- 如果使用GPU预测(即,`use_gpu`置为`true`),则需要在启动服务之前,设置CUDA_VISIBLE_DEVICES环境变量,如:```export CUDA_VISIBLE_DEVICES=0```,否则不用设置。
- **`use_gpu`不可与`use_multiprocess`同时为`true`**。
如,使用GPU 3号卡启动串联服务:
```shell
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment