Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
YOLOv7-tiny_triton
Commits
2949377c
Commit
2949377c
authored
Oct 28, 2023
by
lijian6
Browse files
Update
Signed-off-by:
lijian
<
lijian6@sugon.com
>
parent
f82ffc41
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
15 additions
and
2 deletions
+15
-2
README.md
README.md
+5
-2
model.properties
model.properties
+10
-0
No files found.
README.md
View file @
2949377c
...
...
@@ -19,10 +19,11 @@ docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:tritonserver-2.37.0de
# <your IMAGE ID>用以上拉取的docker的镜像ID替换
docker run --shm-size 10g --network=host --name=tritonserver --privileged --device=/dev/kfd --device=/dev/dri --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -it <your IMAGE ID> bash
triton client端:
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:tritonclient
1
-2.37.0dev_dtk-23.04-ubuntu22.04.
1
-py3
8
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:tritonclient-2.37.0dev_dtk-23.04-ubuntu22.04.
2
-py3
10
# <your IMAGE ID>用以上拉取的docker的镜像ID替换
docker run --shm-size 10g --network=host --name=tritonclient --privileged --device=/dev/kfd --device=/dev/dri --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -it <your IMAGE ID> bash
```
## 推理
### server端运行
...
...
@@ -31,10 +32,12 @@ docker run --shm-size 10g --network=host --name=tritonclient --privileged --devi
cd /opt/tritonserver/
./bin/tritonserver --model-repository=./models/
```
运行完之后server端会等待client端发送推理请求
### client推理请求
```
进入client容器
cd /workspace/install/bin
/
cd /workspace/
client/build/
install/bin
./yolov7-tiny yolov7-tiny /workspace/images/bus.jpg
```
运行yolov7-tiny模型,对bus.jpg图片进行目标检测.
...
...
model.properties
0 → 100644
View file @
2949377c
# 模型唯一标识
modelCode
=
414
# 模型名称
modelName
=
yolov7-tiny_triton
# 模型描述
modelDescription
=
yolov7-tiny triton是用triton框架进行的推理
# 应用场景
appScenario
=
推理,图像分类,制造,环境,医疗,气象
# 框架类型
frameType
=
tvm
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment