ncnn.md 779 Bytes
Newer Older
limm's avatar
limm committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
# Supported ncnn feature

The current use of the ncnn feature is as follows:

|      feature       | windows | linux | mac | android |
| :----------------: | :-----: | :---: | :-: | :-----: |
|   fp32 inference   |   ✔️    |  ✔️   | ✔️  |   ✔️    |
| int8 model convert |    -    |  ✔️   | ✔️  |    -    |
|    nchw layout     |   ✔️    |  ✔️   | ✔️  |   ✔️    |
|   Vulkan support   |    -    |  ✔️   | ✔️  |   ✔️    |

The following features cannot be automatically enabled by mmdeploy and you need to manually modify the ncnn build options or adjust the running parameters in the SDK

- bf16 inference
- nc4hw4 layout
- Profiling per layer
- Turn off NCNN_STRING to reduce .so file size
- Set thread number and CPU affinity