Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
f415dc85
Commit
f415dc85
authored
Apr 28, 2021
by
mpatwary
Browse files
removed commnets
parent
80047314
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
2 deletions
+0
-2
tasks/finetune_utils.py
tasks/finetune_utils.py
+0
-2
No files found.
tasks/finetune_utils.py
View file @
f415dc85
...
...
@@ -90,8 +90,6 @@ def build_data_loader(dataset, micro_batch_size, num_workers, drop_last,
sampler
=
torch
.
utils
.
data
.
distributed
.
DistributedSampler
(
dataset
,
num_replicas
=
world_size
,
rank
=
rank
)
print_rank_0
(
len
(
sampler
))
# Data loader. Note that batch size is the per GPU batch size.
data_loader
=
torch
.
utils
.
data
.
DataLoader
(
dataset
,
batch_size
=
micro_batch_size
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment