trtexec.md 579 Bytes
Newer Older
suily's avatar
suily committed
1
2
3
4
5
6
7
8
9
10
11
12
13

```bash
# build tensorrt engine 
trtexec --onnx=./yolov8l_w_nms.onnx --saveEngine=yolov8l_w_nms.engine --buildOnly --fp16

# using dynamic shapes
# --explicitBatch --minShapes=image:1x3x640x640 --optShapes=image:8x3x640x640  --maxShapes=image:16x3x640x640 --shapes=image:8x3x640x640

# timeline 
nsys profile --force-overwrite=true  -t 'nvtx,cuda,osrt,cudnn' -c cudaProfilerApi -o yolov8l_w_nms  trtexec --loadEngine=./yolov8l_w_nms.engine --fp16 --avgRuns=10 --loadInputs='image:input_tensor.bin'

# https://forums.developer.nvidia.com/t/about-loadinputs-in-trtexec/218880
```