Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
2514892c
Commit
2514892c
authored
Oct 05, 2022
by
mshoeybi
Browse files
fixed the timer issue for the case with no pipelining
parent
b9ae7ba5
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
megatron/schedules.py
megatron/schedules.py
+1
-1
No files found.
megatron/schedules.py
View file @
2514892c
...
...
@@ -237,7 +237,7 @@ def forward_backward_no_pipelining(forward_step_func,
timers
,
collect_non_loss_data
)
if
not
forward_only
:
backward_step
(
optimizer
,
input_tensor
,
output_tensor
,
timers
,
output_tensor_grad
)
output_tensor_grad
,
timers
)
# Run computation for last microbatch out of context handler (want to
# synchronize gradients).
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment