Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
wangsen
paddle_dbnet
Commits
825a2824
Commit
825a2824
authored
Jan 11, 2021
by
LDOUBLEV
Browse files
add use_shared_memory params for AIstudio demo
parent
ccfc7544
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
9 additions
and
4 deletions
+9
-4
configs/det/det_mv3_db.yml
configs/det/det_mv3_db.yml
+3
-1
configs/rec/rec_icdar15_train.yml
configs/rec/rec_icdar15_train.yml
+2
-0
ppocr/data/__init__.py
ppocr/data/__init__.py
+4
-3
No files found.
configs/det/det_mv3_db.yml
View file @
825a2824
...
...
@@ -102,6 +102,7 @@ Train:
drop_last
:
False
batch_size_per_card
:
16
num_workers
:
8
use_shared_memory
:
False
Eval
:
dataset
:
...
...
@@ -128,4 +129,5 @@ Eval:
shuffle
:
False
drop_last
:
False
batch_size_per_card
:
1
# must be 1
num_workers
:
8
\ No newline at end of file
num_workers
:
8
use_shared_memory
:
False
\ No newline at end of file
configs/rec/rec_icdar15_train.yml
View file @
825a2824
...
...
@@ -76,6 +76,7 @@ Train:
batch_size_per_card
:
256
drop_last
:
True
num_workers
:
8
use_shared_memory
:
False
Eval
:
dataset
:
...
...
@@ -96,3 +97,4 @@ Eval:
drop_last
:
False
batch_size_per_card
:
256
num_workers
:
4
use_shared_memory
:
False
ppocr/data/__init__.py
View file @
825a2824
...
...
@@ -66,8 +66,10 @@ def build_dataloader(config, mode, device, logger):
batch_size
=
loader_config
[
'batch_size_per_card'
]
drop_last
=
loader_config
[
'drop_last'
]
num_workers
=
loader_config
[
'num_workers'
]
use_shared_memory
=
False
if
'use_shared_memory'
in
loader_config
.
keys
():
use_shared_memory
=
loader_config
[
'use_shared_memory'
]
else
:
use_shared_memory
=
True
if
mode
==
"Train"
:
#Distribute data to multiple cards
batch_sampler
=
DistributedBatchSampler
(
...
...
@@ -75,7 +77,6 @@ def build_dataloader(config, mode, device, logger):
batch_size
=
batch_size
,
shuffle
=
False
,
drop_last
=
drop_last
)
use_shared_memory
=
True
else
:
#Distribute data to single card
batch_sampler
=
BatchSampler
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment