Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
983cc311
Commit
983cc311
authored
Jan 04, 2021
by
mohammad
Browse files
further refactor, tested, and changed master to main
parent
22fa9bac
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
tasks/finetune_utils.py
tasks/finetune_utils.py
+1
-1
No files found.
tasks/finetune_utils.py
View file @
983cc311
...
...
@@ -255,7 +255,7 @@ def finetune(train_valid_datasets_provider, model_provider,
_
=
load_checkpoint
(
model
,
None
,
None
)
args
.
load
=
original_load
# This is critical when only model is loaded. We should make sure
# ma
ster
parameters are also updated.
# ma
in
parameters are also updated.
optimizer
.
reload_model_params
()
timers
(
'pretrained checkpoint'
).
stop
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment