Fix typo

Tiny typo fix : sedd -> seed

Fix typo
Tiny typo fix : sedd -> seed
f63a8a12 · Nako Sung · GitHub · 46a536cc · f63a8a12
Unverified Commit f63a8a12 authored Aug 08, 2020 by Nako Sung Committed by GitHub Aug 08, 2020
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

megatron/mpu/random.py megatron/mpu/random.py +1 -1

No files found.
--- a/megatron/mpu/random.py
+++ b/megatron/mpu/random.py
@@ -165,7 +165,7 @@ def model_parallel_cuda_manual_seed(seed):
    # 2718 is just for fun and any POSITIVE value will work.
    offset = seed + 2718
    model_parallel_seed = offset + get_model_parallel_rank()
-    # Data parallel gets the original sedd.
+    # Data parallel gets the original seed.
    data_parallel_seed = seed

    if torch.distributed.get_rank() == 0: