Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Fairseq
Commits
9dcee4c7
Commit
9dcee4c7
authored
Jun 18, 2018
by
Myle Ott
Browse files
Store full checkpoints instead of symlinking
parent
d9a13180
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
10 deletions
+2
-10
train.py
train.py
+2
-10
No files found.
train.py
View file @
9dcee4c7
...
...
@@ -287,16 +287,8 @@ def save_checkpoint(args, trainer, epoch_itr, val_loss):
checkpoints
=
[
os
.
path
.
join
(
args
.
save_dir
,
fn
)
for
fn
,
cond
in
checkpoint_conds
.
items
()
if
cond
]
if
len
(
checkpoints
)
>
0
:
for
fn
in
checkpoints
:
if
os
.
path
.
exists
(
fn
):
os
.
remove
(
fn
)
if
not
end_of_epoch
and
args
.
keep_interval_updates
>
0
:
for
cp
in
checkpoints
:
trainer
.
save_checkpoint
(
cp
,
extra_state
)
else
:
trainer
.
save_checkpoint
(
checkpoints
[
0
],
extra_state
)
for
fn
in
checkpoints
[
1
:]:
os
.
symlink
(
os
.
path
.
basename
(
checkpoints
[
0
]),
fn
)
if
not
end_of_epoch
and
args
.
keep_interval_updates
>
0
:
# remove old checkpoints; checkpoints are sorted in descending order
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment