"lm_eval/api/judge_task.py" did not exist on "5d43bb4b807bc6e12f65c385fac737a48853d6ca"
quickstart_en.md 9.31 KB
Newer Older
MissPenguin's avatar
MissPenguin committed
1
2
# PaddleOCR Quick Start

MissPenguin's avatar
MissPenguin committed
3
**Note:** This tutorial mainly introduces the usage of PP-OCR series models, please refer to [PP-Structure Quick Start](../../ppstructure/docs/quickstart_en.md) for the quick use of document analysis related functions.
MissPenguin's avatar
MissPenguin committed
4
5

- [1. Installation](#1-installation)
WenmuZhou's avatar
WenmuZhou committed
6
7
    - [1.1 Install PaddlePaddle](#11-install-paddlepaddle)
    - [1.2 Install PaddleOCR Whl Package](#12-install-paddleocr-whl-package)
freeliuzc's avatar
freeliuzc committed
8
    - [1.3 Use PaddleOCR with Docker](#13-use-paddleocr-with-docker)
MissPenguin's avatar
MissPenguin committed
9
- [2. Easy-to-Use](#2-easy-to-use)
WenmuZhou's avatar
WenmuZhou committed
10
11
12
13
14
    - [2.1 Use by Command Line](#21-use-by-command-line)
      - [2.1.1 Chinese and English Model](#211-chinese-and-english-model)
      - [2.1.2 Multi-language Model](#212-multi-language-model)
    - [2.2 Use by Code](#22-use-by-code)
      - [2.2.1 Chinese & English Model and Multilingual Model](#221-chinese--english-model-and-multilingual-model)
MissPenguin's avatar
MissPenguin committed
15
- [3. Summary](#3-summary)
littletomatodonkey's avatar
littletomatodonkey committed
16
17
18



Leif's avatar
Leif committed
19
<a name="1nstallation"></a>
littletomatodonkey's avatar
littletomatodonkey committed
20

Leif's avatar
Leif committed
21
## 1. Installation
littletomatodonkey's avatar
littletomatodonkey committed
22

Leif's avatar
Leif committed
23
<a name="11-install-paddlepaddle"></a>
WenmuZhou's avatar
WenmuZhou committed
24

Leif's avatar
Leif committed
25
26
27
### 1.1 Install PaddlePaddle

> If you do not have a Python environment, please refer to [Environment Preparation](./environment_en.md).
littletomatodonkey's avatar
littletomatodonkey committed
28

Leif's avatar
Leif committed
29
- If you have CUDA 9 or CUDA 10 installed on your machine, please run the following command to install
littletomatodonkey's avatar
littletomatodonkey committed
30

Leif's avatar
Leif committed
31
  ```bash
DanielYang's avatar
DanielYang committed
32
  python3 -m pip install paddlepaddle-gpu
Leif's avatar
Leif committed
33
34
35
36
37
  ```

- If you have no available GPU on your machine, please run the following command to install the CPU version

  ```bash
DanielYang's avatar
DanielYang committed
38
  python3 -m pip install paddlepaddle
Leif's avatar
Leif committed
39
  ```
littletomatodonkey's avatar
littletomatodonkey committed
40

Leif's avatar
Leif committed
41
For more software version requirements, please refer to the instructions in [Installation Document](https://www.paddlepaddle.org.cn/install/quick) for operation.
WenmuZhou's avatar
WenmuZhou committed
42

Leif's avatar
Leif committed
43
44
45
<a name="12-install-paddleocr-whl-package"></a>

### 1.2 Install PaddleOCR Whl Package
Leif's avatar
Leif committed
46
47
48

```bash
pip install "paddleocr>=2.0.1" # Recommend to use version 2.0.1+
littletomatodonkey's avatar
littletomatodonkey committed
49
50
```

Leif's avatar
Leif committed
51
- **For windows users:** If you getting this error `OSError: [WinError 126] The specified module could not be found` when you install shapely on windows. Please try to download Shapely whl file [here](http://www.lfd.uci.edu/~gohlke/pythonlibs/#shapely).
Leif's avatar
Leif committed
52

Leif's avatar
Leif committed
53
  Reference: [Solve shapely installation on windows](https://stackoverflow.com/questions/44398265/install-shapely-oserror-winerror-126-the-specified-module-could-not-be-found)
Leif's avatar
Leif committed
54

Leif's avatar
Leif committed
55
- **For layout analysis users**, run the following command to install **Layout-Parser**
littletomatodonkey's avatar
littletomatodonkey committed
56

Leif's avatar
Leif committed
57
58
59
  ```bash
  pip3 install -U https://paddleocr.bj.bcebos.com/whl/layoutparser-0.0.0-py3-none-any.whl
  ```
freeliuzc's avatar
freeliuzc committed
60
61
62
63
64
65
66
67
68
69
70
<a name="13-use-paddleocr-with-docker"></a>

### 1.3 Use PaddleOCR with Docker

> If you  do not have a Docker environment, please refer to [Docker](https://www.docker.com/).

PaddleOCR provides built docker images with latest code. All you have to do is to **pull the docker image **and **run the docker image**. Then you can enjoy PaddleOCR without any extra action.

Get these images and guidance in [docker hub](https://hub.docker.com/repository/docker/paddlecloud/paddleocr), including CPU, GPU, ROCm environment versions. 

If you have some customized requirements about automatic building docker images, you can get it in github repo [PaddlePaddle/PaddleCloud](https://github.com/PaddlePaddle/PaddleCloud/tree/main/tekton).
Leif's avatar
Leif committed
71
72
73
74
75
76
77

<a name="2-easy-to-use"></a>

## 2. Easy-to-Use

<a name="21-use-by-command-line"></a>

78
### 2.1 Use by Command Line
Leif's avatar
Leif committed
79

Leif's avatar
Leif committed
80
PaddleOCR provides a series of test images, click [here](https://paddleocr.bj.bcebos.com/dygraph_v2.1/ppocr_img.zip) to download, and then switch to the corresponding directory in the terminal
Leif's avatar
Leif committed
81
82

```bash
Leif's avatar
Leif committed
83
cd /path/to/ppocr_img
littletomatodonkey's avatar
littletomatodonkey committed
84
```
Leif's avatar
Leif committed
85

Leif's avatar
Leif committed
86
If you do not use the provided test image, you can replace the following `--image_dir` parameter with the corresponding test image path
Leif's avatar
Leif committed
87

Leif's avatar
Leif committed
88
<a name="211-english-and-chinese-model"></a>
Leif's avatar
Leif committed
89

Leif's avatar
Leif committed
90
#### 2.1.1 Chinese and English Model
Leif's avatar
Leif committed
91

92
* Detection, direction classification and recognition: set the parameter`--use_gpu false` to disable the gpu device
Leif's avatar
Leif committed
93

Leif's avatar
Leif committed
94
  ```bash
andyjpaddle's avatar
andyjpaddle committed
95
  paddleocr --image_dir ./imgs_en/img_12.jpg --use_angle_cls true --lang en --use_gpu false
Leif's avatar
Leif committed
96
  ```
littletomatodonkey's avatar
littletomatodonkey committed
97

Leif's avatar
Leif committed
98
  Output will be a list, each item contains bounding box, text and recognition confidence
littletomatodonkey's avatar
littletomatodonkey committed
99

Leif's avatar
Leif committed
100
  ```bash
101
102
103
  [[[441.0, 174.0], [1166.0, 176.0], [1165.0, 222.0], [441.0, 221.0]], ('ACKNOWLEDGEMENTS', 0.9971134662628174)]
  [[[403.0, 346.0], [1204.0, 348.0], [1204.0, 384.0], [402.0, 383.0]], ('We would like to thank all the designers and', 0.9761400818824768)]
  [[[403.0, 396.0], [1204.0, 398.0], [1204.0, 434.0], [402.0, 433.0]], ('contributors who have been involved in the', 0.9791957139968872)]
Leif's avatar
Leif committed
104
105
106
107
108
109
110
111
  ......
  ```

* Only detection: set `--rec` to `false`

  ```bash
  paddleocr --image_dir ./imgs_en/img_12.jpg --rec false
  ```
Leif's avatar
Leif committed
112

Leif's avatar
Leif committed
113
114
115
  Output will be a list, each item only contains bounding box

  ```bash
116
117
118
  [[397.0, 802.0], [1092.0, 802.0], [1092.0, 841.0], [397.0, 841.0]]
  [[397.0, 750.0], [1211.0, 750.0], [1211.0, 789.0], [397.0, 789.0]]
  [[397.0, 702.0], [1209.0, 698.0], [1209.0, 734.0], [397.0, 738.0]]
Leif's avatar
Leif committed
119
120
121
122
123
124
  ......
  ```

* Only recognition: set `--det` to `false`

  ```bash
andyjpaddle's avatar
andyjpaddle committed
125
  paddleocr --image_dir ./imgs_words_en/word_10.png --det false --lang en
Leif's avatar
Leif committed
126
127
128
129
130
  ```

  Output will be a list, each item contains text and recognition confidence

  ```bash
131
  ['PAIN', 0.9934559464454651]
Leif's avatar
Leif committed
132
133
  ```

134
135
136
137
138
139
140
141
142
143
144
145
**Version**
paddleocr uses the PP-OCRv3 model by default(`--ocr_version PP-OCRv3`). If you want to use other versions, you can set the parameter `--ocr_version`, the specific version description is as follows:
|  version name |  description |
|    ---    |   ---   |
| PP-OCRv3 | support Chinese and English detection and recognition, direction classifier, support multilingual recognition |
| PP-OCRv2 | only supports Chinese and English detection and recognition, direction classifier, multilingual model is not updated |
| PP-OCR   | support Chinese and English detection and recognition, direction classifier, support multilingual recognition |

If you want to add your own trained model, you can add model links and keys in [paddleocr](../../paddleocr.py) and recompile.

More whl package usage can be found in [whl package](./whl_en.md)

Leif's avatar
Leif committed
146
<a name="212-multi-language-model"></a>
Leif's avatar
Leif committed
147
148
149

#### 2.1.2 Multi-language Model

andyjpaddle's avatar
andyjpaddle committed
150
PaddleOCR currently supports 80 languages, which can be switched by modifying the `--lang` parameter.
Leif's avatar
Leif committed
151
152

``` bash
andyjpaddle's avatar
andyjpaddle committed
153
paddleocr --image_dir ./doc/imgs_en/254.jpg --lang=en
littletomatodonkey's avatar
littletomatodonkey committed
154
155
```

Leif's avatar
Leif committed
156
157
158
159
160
161
162
<div align="center">
    <img src="../imgs_en/254.jpg" width="300" height="600">
    <img src="../imgs_results/multi_lang/img_02.jpg" width="600" height="600">
</div>
The result is a list, each item contains a text box, text and recognition confidence

```text
163
164
165
[[[67.0, 51.0], [327.0, 46.0], [327.0, 74.0], [68.0, 80.0]], ('PHOCAPITAL', 0.9944712519645691)]
[[[72.0, 92.0], [453.0, 84.0], [454.0, 114.0], [73.0, 122.0]], ('107 State Street', 0.9744491577148438)]
[[[69.0, 135.0], [501.0, 125.0], [501.0, 156.0], [70.0, 165.0]], ('Montpelier Vermont', 0.9357033967971802)]
Leif's avatar
Leif committed
166
167
......
```
littletomatodonkey's avatar
littletomatodonkey committed
168

Leif's avatar
Leif committed
169
Commonly used multilingual abbreviations include
littletomatodonkey's avatar
littletomatodonkey committed
170

Leif's avatar
Leif committed
171
172
173
174
175
| Language            | Abbreviation |      | Language | Abbreviation |      | Language | Abbreviation |
| ------------------- | ------------ | ---- | -------- | ------------ | ---- | -------- | ------------ |
| Chinese & English   | ch           |      | French   | fr           |      | Japanese | japan        |
| English             | en           |      | German   | german       |      | Korean   | korean       |
| Chinese Traditional | chinese_cht  |      | Italian  | it           |      | Russian  | ru           |
littletomatodonkey's avatar
littletomatodonkey committed
176

Leif's avatar
Leif committed
177
A list of all languages and their corresponding abbreviations can be found in [Multi-Language Model Tutorial](./multi_languages_en.md)
littletomatodonkey's avatar
littletomatodonkey committed
178

Leif's avatar
Leif committed
179

Leif's avatar
Leif committed
180
<a name="22-use-by-code"></a>
Leif's avatar
Leif committed
181

Leif's avatar
Leif committed
182
183
### 2.2 Use by Code
<a name="221-chinese---english-model-and-multilingual-model"></a>
Leif's avatar
Leif committed
184

Leif's avatar
Leif committed
185
#### 2.2.1 Chinese & English Model and Multilingual Model
Leif's avatar
Leif committed
186

Leif's avatar
Leif committed
187
* detection, angle classification and recognition:
Leif's avatar
Leif committed
188

Leif's avatar
Leif committed
189
190
191
192
193
194
195
```python
from paddleocr import PaddleOCR,draw_ocr
# Paddleocr supports Chinese, English, French, German, Korean and Japanese.
# You can set the parameter `lang` as `ch`, `en`, `fr`, `german`, `korean`, `japan`
# to switch the language model in order.
ocr = PaddleOCR(use_angle_cls=True, lang='en') # need to run only once to download and load model into memory
img_path = './imgs_en/img_12.jpg'
Leif's avatar
Leif committed
196
197
198
199
200
result = ocr.ocr(img_path, cls=True)
for line in result:
    print(line)


Leif's avatar
Leif committed
201
202
# draw result
from PIL import Image
Leif's avatar
Leif committed
203
204
205
206
image = Image.open(img_path).convert('RGB')
boxes = [line[0] for line in result]
txts = [line[1][0] for line in result]
scores = [line[1][1] for line in result]
Leif's avatar
Leif committed
207
im_show = draw_ocr(image, boxes, txts, scores, font_path='./fonts/simfang.ttf')
Leif's avatar
Leif committed
208
209
im_show = Image.fromarray(im_show)
im_show.save('result.jpg')
littletomatodonkey's avatar
littletomatodonkey committed
210
```
Leif's avatar
Leif committed
211

Leif's avatar
Leif committed
212
Output will be a list, each item contains bounding box, text and recognition confidence
Leif's avatar
Leif committed
213
214

```bash
215
216
217
218
[[[441.0, 174.0], [1166.0, 176.0], [1165.0, 222.0], [441.0, 221.0]], ('ACKNOWLEDGEMENTS', 0.9971134662628174)]
  [[[403.0, 346.0], [1204.0, 348.0], [1204.0, 384.0], [402.0, 383.0]], ('We would like to thank all the designers and', 0.9761400818824768)]
  [[[403.0, 396.0], [1204.0, 398.0], [1204.0, 434.0], [402.0, 433.0]], ('contributors who have been involved in the', 0.9791957139968872)]
  ......
littletomatodonkey's avatar
littletomatodonkey committed
219
220
```

Leif's avatar
Leif committed
221
Visualization of results
littletomatodonkey's avatar
littletomatodonkey committed
222

Leif's avatar
Leif committed
223
<div align="center">
Leif's avatar
Leif committed
224
    <img src="../imgs_results/whl/12_det_rec.jpg" width="800">
Leif's avatar
Leif committed
225
</div>
Leif's avatar
Leif committed
226

Leif's avatar
Leif committed
227
228
229
230
231

<a name="3"></a>

## 3. Summary

MissPenguin's avatar
MissPenguin committed
232
In this section, you have mastered the use of PaddleOCR whl package.
Leif's avatar
Leif committed
233

andyjpaddle's avatar
andyjpaddle committed
234
PaddleOCR is a rich and practical OCR tool library that get through the whole process of data production, model training, compression, inference and deployment, please refer to the [tutorials](../../README.md#tutorials) to start the journey of PaddleOCR.