Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
52b2296b
Commit
52b2296b
authored
Aug 17, 2021
by
Lawrence McAfee
Browse files
updated argument name
parent
9dec5374
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
megatron/arguments.py
megatron/arguments.py
+1
-1
No files found.
megatron/arguments.py
View file @
52b2296b
...
@@ -601,7 +601,7 @@ def _add_distributed_args(parser):
...
@@ -601,7 +601,7 @@ def _add_distributed_args(parser):
group
.
add_argument
(
'--use-cpu-initialization'
,
action
=
'store_true'
,
group
.
add_argument
(
'--use-cpu-initialization'
,
action
=
'store_true'
,
default
=
None
,
help
=
'If set, affine parallel weights '
default
=
None
,
help
=
'If set, affine parallel weights '
'initialization uses CPU'
)
'initialization uses CPU'
)
group
.
add_argument
(
'--empty-unused-memory-
each-iter
'
,
default
=
0
,
type
=
int
,
group
.
add_argument
(
'--empty-unused-memory-
level
'
,
default
=
0
,
type
=
int
,
choices
=
[
0
,
1
,
2
],
choices
=
[
0
,
1
,
2
],
help
=
'Call torch.cuda.empty_cache() each iteration '
help
=
'Call torch.cuda.empty_cache() each iteration '
'(training and eval), to reduce fragmentation.'
'(training and eval), to reduce fragmentation.'
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment