algorithm_overview.md 4.52 KB
Newer Older
WenmuZhou's avatar
WenmuZhou committed
1
2
<a name="算法介绍"></a>
## 算法介绍
3
本文给出了PaddleOCR已支持的文本检测算法和文本识别算法列表,以及每个算法在**英文公开数据集**上的模型和指标,主要用于算法简介和算法性能对比,更多包括中文在内的其他数据集上的模型请参考[PP-OCR v2.0 系列模型下载](./models_list.md)
WenmuZhou's avatar
WenmuZhou committed
4
5
6
7
8
9
10
11

- [1.文本检测算法](#文本检测算法)
- [2.文本识别算法](#文本识别算法)

<a name="文本检测算法"></a>
### 1.文本检测算法

PaddleOCR开源的文本检测算法列表:
dyning's avatar
dyning committed
12
13
14
- [x]  DB([paper]( https://arxiv.org/abs/1911.08947)) [2](ppocr推荐)
- [x]  EAST([paper](https://arxiv.org/abs/1704.03155))[1]
- [x]  SAST([paper](https://arxiv.org/abs/1908.05498))[4]
WenmuZhou's avatar
WenmuZhou committed
15
16
17

在ICDAR2015文本检测公开数据集上,算法效果如下:
|模型|骨干网络|precision|recall|Hmean|下载链接|
MissPenguin's avatar
MissPenguin committed
18
| --- | --- | --- | --- | --- | --- |
MissPenguin's avatar
MissPenguin committed
19
20
|EAST|ResNet50_vd|85.80%|86.71%|86.25%|[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/det_r50_vd_east_v2.0_train.tar)|
|EAST|MobileNetV3|79.42%|80.64%|80.03%|[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/det_mv3_east_v2.0_train.tar)|
MissPenguin's avatar
MissPenguin committed
21
22
|DB|ResNet50_vd|86.41%|78.72%|82.38%|[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/det_r50_vd_db_v2.0_train.tar)|
|DB|MobileNetV3|77.29%|73.08%|75.12%|[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/det_mv3_db_v2.0_train.tar)|
MissPenguin's avatar
MissPenguin committed
23
|SAST|ResNet50_vd|91.39%|83.77%|87.42%|[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/det_r50_vd_sast_icdar15_v2.0_train.tar)|
WenmuZhou's avatar
WenmuZhou committed
24
25
26
27

在Total-text文本检测公开数据集上,算法效果如下:

|模型|骨干网络|precision|recall|Hmean|下载链接|
MissPenguin's avatar
MissPenguin committed
28
| --- | --- | --- | --- | --- | --- |
MissPenguin's avatar
MissPenguin committed
29
|SAST|ResNet50_vd|89.63%|78.44%|83.66%|[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/det_r50_vd_sast_totaltext_v2.0_train.tar)|
WenmuZhou's avatar
WenmuZhou committed
30
31
32
33
34
35
36
37
38

**说明:** SAST模型训练额外加入了icdar2013、icdar2017、COCO-Text、ArT等公开数据集进行调优。PaddleOCR用到的经过整理格式的英文公开数据集下载:[百度云地址](https://pan.baidu.com/s/12cPnZcVuV1zn5DOd4mqjVw) (提取码: 2bpi)

PaddleOCR文本检测算法的训练和使用请参考文档教程中[模型训练/评估中的文本检测部分](./detection.md)


<a name="文本识别算法"></a>
### 2.文本识别算法

tink2123's avatar
tink2123 committed
39
PaddleOCR基于动态图开源的文本识别算法列表:
dyning's avatar
dyning committed
40
41
- [x]  CRNN([paper](https://arxiv.org/abs/1507.05717))[7](ppocr推荐)
- [x]  Rosetta([paper](https://arxiv.org/abs/1910.05085))[10]
WenmuZhou's avatar
WenmuZhou committed
42
- [x]  STAR-Net([paper](http://www.bmva.org/bmvc/2016/papers/paper043/index.html))[11]
LDOUBLEV's avatar
LDOUBLEV committed
43
- [x]  RARE([paper](https://arxiv.org/abs/1603.03915v1))[12]
tink2123's avatar
tink2123 committed
44
- [x]  SRN([paper](https://arxiv.org/abs/2003.12294))[5]
WenmuZhou's avatar
WenmuZhou committed
45

dyning's avatar
dyning committed
46
参考[DTRB][3](https://arxiv.org/abs/1904.01906)文字识别训练和评估流程,使用MJSynth和SynthText两个文字识别数据集训练,在IIIT, SVT, IC03, IC13, IC15, SVTP, CUTE数据集上进行评估,算法效果如下:
WenmuZhou's avatar
WenmuZhou committed
47
48

|模型|骨干网络|Avg Accuracy|模型存储命名|下载链接|
WenmuZhou's avatar
WenmuZhou committed
49
|---|---|---|---|---|
MissPenguin's avatar
MissPenguin committed
50
51
52
53
|Rosetta|Resnet34_vd|80.9%|rec_r34_vd_none_none_ctc|[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/rec_r34_vd_none_none_ctc_v2.0_train.tar)|
|Rosetta|MobileNetV3|78.05%|rec_mv3_none_none_ctc|[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/rec_mv3_none_none_ctc_v2.0_train.tar)|
|CRNN|Resnet34_vd|82.76%|rec_r34_vd_none_bilstm_ctc|[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/rec_r34_vd_none_bilstm_ctc_v2.0_train.tar)|
|CRNN|MobileNetV3|79.97%|rec_mv3_none_bilstm_ctc|[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/rec_mv3_none_bilstm_ctc_v2.0_train.tar)|
WenmuZhou's avatar
WenmuZhou committed
54
55
|StarNet|Resnet34_vd|84.44%|rec_r34_vd_tps_bilstm_ctc|[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/rec_r34_vd_tps_bilstm_ctc_v2.0_train.tar)|
|StarNet|MobileNetV3|81.42%|rec_mv3_tps_bilstm_ctc|[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/rec_mv3_tps_bilstm_ctc_v2.0_train.tar)|
LDOUBLEV's avatar
LDOUBLEV committed
56
57
|RARE|MobileNetV3|82.5|rec_mv3_tps_bilstm_att |[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/rec_mv3_tps_bilstm_att_v2.0_train.tar)|
|RARE|Resnet34_vd|83.6|rec_r34_vd_tps_bilstm_att |[下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/rec_r34_vd_tps_bilstm_att_v2.0_train.tar)|
tink2123's avatar
tink2123 committed
58
|SRN|Resnet50_vd_fpn| 88.52% | rec_r50fpn_vd_none_srn | [下载链接](https://paddleocr.bj.bcebos.com/dygraph_v2.0/en/rec_r50_vd_srn_train.tar) |
tink2123's avatar
tink2123 committed
59

LDOUBLEV's avatar
LDOUBLEV committed
60

WenmuZhou's avatar
WenmuZhou committed
61
PaddleOCR文本识别算法的训练和使用请参考文档教程中[模型训练/评估中的文本识别部分](./recognition.md)