Commit 2949377c authored by lijian6's avatar lijian6
Browse files

Update


Signed-off-by: lijian6's avatarlijian <lijian6@sugon.com>
parent f82ffc41
......@@ -19,10 +19,11 @@ docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:tritonserver-2.37.0de
# <your IMAGE ID>用以上拉取的docker的镜像ID替换
docker run --shm-size 10g --network=host --name=tritonserver --privileged --device=/dev/kfd --device=/dev/dri --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -it <your IMAGE ID> bash
triton client端:
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:tritonclient1-2.37.0dev_dtk-23.04-ubuntu22.04.1-py38
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:tritonclient-2.37.0dev_dtk-23.04-ubuntu22.04.2-py310
# <your IMAGE ID>用以上拉取的docker的镜像ID替换
docker run --shm-size 10g --network=host --name=tritonclient --privileged --device=/dev/kfd --device=/dev/dri --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -it <your IMAGE ID> bash
```
## 推理
### server端运行
......@@ -31,10 +32,12 @@ docker run --shm-size 10g --network=host --name=tritonclient --privileged --devi
cd /opt/tritonserver/
./bin/tritonserver --model-repository=./models/
```
运行完之后server端会等待client端发送推理请求
### client推理请求
```
进入client容器
cd /workspace/install/bin/
cd /workspace/client/build/install/bin
./yolov7-tiny yolov7-tiny /workspace/images/bus.jpg
```
运行yolov7-tiny模型,对bus.jpg图片进行目标检测.
......
# 模型唯一标识
modelCode = 414
# 模型名称
modelName=yolov7-tiny_triton
# 模型描述
modelDescription=yolov7-tiny triton是用triton框架进行的推理
# 应用场景
appScenario=推理,图像分类,制造,环境,医疗,气象
# 框架类型
frameType=tvm
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment