Skip to content

GitLab

Unverified Commit 9edfdaec authored by Nako Sung's avatar Nako Sung Committed by GitHub
Browse files

Fix typo 

redcue -> reduce
parent 46a536cc
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
megatron/mpu/mappings.py
View file @ 9edfdaec
...@@ -89,7 +89,7 @@ class _CopyToModelParallelRegion(torch.autograd.Function): ...@@ -89,7 +89,7 @@ class _CopyToModelParallelRegion(torch.autograd.Function):
class _ReduceFromModelParallelRegion(torch.autograd.Function): class _ReduceFromModelParallelRegion(torch.autograd.Function):
"""All-redcue the input from the model parallel region.""" """All-reduce the input from the model parallel region."""
@staticmethod @staticmethod
def forward(ctx, input_): def forward(ctx, input_):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment