README.md 2.89 KB
Newer Older
bailuo's avatar
readme  
bailuo committed
1
2
3
# SOLOv2
## 论文
[SOLOv2](https://arxiv.org/abs/2003.10152)
pangjm's avatar
pangjm committed
4

Kai Chen's avatar
Kai Chen committed
5

bailuo's avatar
readme  
bailuo committed
6
7
## 模型简介
SOLO v2遵循了SOLO的优雅、简单的设计,并且针对mask的检测效果和运行效率做了两个改进:
Dahua Lin's avatar
Dahua Lin committed
8

bailuo's avatar
readme  
bailuo committed
9
(1)mask learning:能够更好地学习到mask;
Kai Chen's avatar
Kai Chen committed
10

bailuo's avatar
readme  
bailuo committed
11
(2)mask NMS:提出了matrix nms,大大减少了前向推理的时间。
Dahua Lin's avatar
Dahua Lin committed
12

Kai Chen's avatar
Kai Chen committed
13

Dahua Lin's avatar
Dahua Lin committed
14

bailuo's avatar
readme  
bailuo committed
15
16
## 环境依赖
- 列举基础环境需求,根据实际情况填写
Kai Chen's avatar
Kai Chen committed
17

bailuo's avatar
readme  
bailuo committed
18
19
20
21
22
| 软件 | 版本 |
| :------: | :------: |
| DTK | 25.04.1 |
| python | 3.11 |
| torch | 2.4.1+das.opt1.dtk25041 |
Dahua Lin's avatar
Dahua Lin committed
23

Kai Chen's avatar
Kai Chen committed
24

bailuo's avatar
readme  
bailuo committed
25
26
推荐使用镜像:
- 挂载地址 `-v` 根据实际模型情况修改
Kai Chen's avatar
Kai Chen committed
27

bailuo's avatar
readme  
bailuo committed
28
29
30
31
```bash
docker run -it --shm-size 50g --network=host --name solov2 --privileged --device=/dev/kfd --device=/dev/dri --device=/dev/mkfd --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root -v /opt/hyhal/:/opt/hyhal/:ro -v /path/your_code_path/:/path/your_code_path/ image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.4.1-ubuntu22.04-dtk25.04.1-py3.11 bash
```
更多镜像可前往[光源](https://sourcefind.cn/#/service-list)下载使用。
Kai Chen's avatar
Kai Chen committed
32

bailuo's avatar
readme  
bailuo committed
33
34
35
36
关于本项目DCU显卡所需的特殊深度学习库可从[光合](https://developer.sourcefind.cn/tool/)开发者社区下载安装,其它包参照requirements.txt安装:
```
pip install -r requirements.txt
```
Kai Chen's avatar
Kai Chen committed
37

bailuo's avatar
readme  
bailuo committed
38
39
## 数据集
[COCO](https://cocodataset.org/#home)
Xinlong Wang's avatar
Xinlong Wang committed
40
41


bailuo's avatar
readme  
bailuo committed
42
## 训练
Kai Chen's avatar
Kai Chen committed
43

bailuo's avatar
readme  
bailuo committed
44
45
46
### 单机训练
```bash
python tools/train.py ${CONFIG_FILE}
Kai Chen's avatar
Kai Chen committed
47

bailuo's avatar
readme  
bailuo committed
48
49
50
Example:
python tools/train.py configs/solo/solo_r50_fpn_8gpu_1x.py
```
Kai Chen's avatar
Kai Chen committed
51

bailuo's avatar
readme  
bailuo committed
52
53
54
### 多机训练
```bash
./tools/dist_train.sh ${CONFIG_FILE} ${GPU_NUM}
Xinlong Wang's avatar
Xinlong Wang committed
55

bailuo's avatar
readme  
bailuo committed
56
57
58
Example: 
./tools/dist_train.sh configs/solo/solo_r50_fpn_8gpu_1x.py  8
```
Xinlong Wang's avatar
Xinlong Wang committed
59

bailuo's avatar
readme  
bailuo committed
60
## 推理
Kai Chen's avatar
Kai Chen committed
61

bailuo's avatar
readme  
bailuo committed
62
63
64
### 单机推理
```bash
python tools/test_ins.py ${CONFIG_FILE} ${CHECKPOINT_FILE} --show --out  ${OUTPUT_FILE} --eval segm
Kai Chen's avatar
Kai Chen committed
65

bailuo's avatar
readme  
bailuo committed
66
67
68
Example: 
python tools/test_ins.py configs/solo/solo_r50_fpn_8gpu_1x.py  SOLO_R50_1x.pth --show --out  results_solo.pkl --eval segm
```
Kai Chen's avatar
Kai Chen committed
69

bailuo's avatar
readme  
bailuo committed
70
71
72
### 多机推理
```bash
./tools/dist_test.sh ${CONFIG_FILE} ${CHECKPOINT_FILE} ${GPU_NUM}  --show --out  ${OUTPUT_FILE} --eval segm
Kai Chen's avatar
Kai Chen committed
73

bailuo's avatar
readme  
bailuo committed
74
75
Example: 
./tools/dist_test.sh configs/solo/solo_r50_fpn_8gpu_1x.py SOLO_R50_1x.pth  8  --show --out results_solo.pkl --eval segm
Kai Chen's avatar
Kai Chen committed
76
```
Xinlong Wang's avatar
Xinlong Wang committed
77

Kai Chen's avatar
Kai Chen committed
78

bailuo's avatar
readme  
bailuo committed
79
80
81
82
83
84
85
86
87
### 精度
DCU与GPU精度一致

## 预训练权重
| 模型名称  | 权重大小  | DCU型号  | 最低卡数需求 |下载地址|
|:-----:|:----------:|:----------:|:---------------------:|:----------:|
| SOLO_R50_1x | 3.7GB | K100AI | 1 | [下载地址](https://huggingface.co/xinlongwang/SOLO/resolve/main/SOLOv2_R50_1x.pth?download=true) |
| SOLO_R50_3x | 3.7GB | K100AI | 1 | [下载地址](https://huggingface.co/xinlongwang/SOLO/resolve/main/SOLOv2_R50_3x.pth?download=true) |
| SOLO_R101_3x | 4.7GB | K100AI | 1 | [下载地址](https://huggingface.co/xinlongwang/SOLO/resolve/main/SOLOv2_R101_3x.pth?download=true) |
WXinlong's avatar
WXinlong committed
88

bailuo's avatar
readme  
bailuo committed
89
90
## 源码仓库及问题反馈
- https://developer.sourcefind.cn/codes/modelzoo/solov2-pytorch
WXinlong's avatar
WXinlong committed
91

bailuo's avatar
readme  
bailuo committed
92
93
## 参考资料
- https://github.com/WXinlong/SOLO