Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
deepspeed
Commits
e9b097f1
Commit
e9b097f1
authored
Feb 03, 2020
by
Shaden Smith
Browse files
examples -> DeepSpeedExamples
parent
681001fb
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
tests/model/Megatron_GPT2/ds_gpt2_test.sh
tests/model/Megatron_GPT2/ds_gpt2_test.sh
+1
-1
No files found.
tests/model/Megatron_GPT2/ds_gpt2_test.sh
View file @
e9b097f1
...
...
@@ -91,7 +91,7 @@ gpt_options=" \
${
zero_opt
}
\
"
work_dir
=
"../../../
e
xamples/Megatron-LM/"
work_dir
=
"../../../
DeepSpeedE
xamples/Megatron-LM/"
include_str
=
`
seq
0
$((
$gpus
-
1
))
|
paste
-sd
","
-
`
run_cmd
=
"(cd
${
work_dir
}
&& deepspeed.pt -i localhost:
${
include_str
}
pretrain_gpt2.py
${
gpt_options
}
)"
echo
${
run_cmd
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment