Commit 4e8ace9b authored by Boris Fomitchev's avatar Boris Fomitchev
Browse files

comment fix


Signed-off-by: default avatarBoris Fomitchev <bfomitchev@nvidia.com>
parent 39c80331
......@@ -36,7 +36,7 @@ def initialize_megatron(extra_args_provider=None, args_defaults={},
data processing. In general this arg should not be set unless you know
what you are doing.
Returns a function to finalize distributed env initialization
(optionally, only for args.distributed_backend == "external_ddp")
(optionally, only when args.lazy_mpu_init == True)
"""
if not allow_no_cuda:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment