Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
4147bec2
Commit
4147bec2
authored
Feb 01, 2022
by
Jared Casper
Browse files
Fix typo that prevented non-pipelined models from loading.
parent
3b9dc880
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
megatron/checkpointing.py
megatron/checkpointing.py
+1
-1
No files found.
megatron/checkpointing.py
View file @
4147bec2
...
@@ -89,7 +89,7 @@ def get_checkpoint_name(checkpoints_path, iteration, release=False,
...
@@ -89,7 +89,7 @@ def get_checkpoint_name(checkpoints_path, iteration, release=False,
directory
=
'iter_{:07d}'
.
format
(
iteration
)
directory
=
'iter_{:07d}'
.
format
(
iteration
)
# Use both the tensor and pipeline MP rank.
# Use both the tensor and pipeline MP rank.
if
pipeline_parallel_size
is
None
:
if
pipeline_parallel_size
is
None
:
parallel_size
=
mpu
.
get_pipeline_model_parallel_world_size
()
pipeline_
parallel_size
=
mpu
.
get_pipeline_model_parallel_world_size
()
if
tensor_rank
is
None
:
if
tensor_rank
is
None
:
tensor_rank
=
mpu
.
get_tensor_model_parallel_rank
()
tensor_rank
=
mpu
.
get_tensor_model_parallel_rank
()
if
pipeline_rank
is
None
:
if
pipeline_rank
is
None
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment