Skip to content

GitLab

Commit 4e8ace9b authored by Boris Fomitchev's avatar Boris Fomitchev
Browse files

comment fix 


Signed-off-by: default avatarBoris Fomitchev <bfomitchev@nvidia.com>
parent 39c80331
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
megatron/initialize.py
View file @ 4e8ace9b
...@@ -36,7 +36,7 @@ def initialize_megatron(extra_args_provider=None, args_defaults={}, ...@@ -36,7 +36,7 @@ def initialize_megatron(extra_args_provider=None, args_defaults={},
data processing. In general this arg should not be set unless you know data processing. In general this arg should not be set unless you know
what you are doing. what you are doing.
Returns a function to finalize distributed env initialization Returns a function to finalize distributed env initialization
(optionally, only for args.distributed_backend == "external_ddp") (optionally, only when args.lazy_mpu_init == True)
""" """
if not allow_no_cuda: if not allow_no_cuda:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment