Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
deepspeed
Commits
78e776a9
Unverified
Commit
78e776a9
authored
Feb 12, 2021
by
Stas Bekman
Committed by
GitHub
Feb 12, 2021
Browse files
[install] fixes/improvements/docs (#752)
Co-authored-by:
Jeff Rasley
<
jerasley@microsoft.com
>
parent
6fb16100
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
16 additions
and
4 deletions
+16
-4
docs/_tutorials/advanced-install.md
docs/_tutorials/advanced-install.md
+8
-0
install.sh
install.sh
+8
-4
No files found.
docs/_tutorials/advanced-install.md
View file @
78e776a9
...
@@ -65,6 +65,14 @@ Available `DS_BUILD` options include:
...
@@ -65,6 +65,14 @@ Available `DS_BUILD` options include:
*
`DS_BUILD_STOCHASTIC_TRANSFORMER`
builds the stochastic transformer op
*
`DS_BUILD_STOCHASTIC_TRANSFORMER`
builds the stochastic transformer op
*
`DS_BUILD_UTILS`
builds various optimized utilities
*
`DS_BUILD_UTILS`
builds various optimized utilities
To speed up the build-all process, you can parallelize the compilation process with:
```
bash
DS_BUILD_OPS
=
1 pip
install
deepspeed
--global-option
=
"build_ext"
--global-option
=
"-j8"
```
This should complete the full build 2-3 times faster. You can adjust
`-j`
to specify how many cpu-cores are to be used during the build. In the example it is set to 8 cores.
## Install DeepSpeed from source
## Install DeepSpeed from source
...
...
install.sh
View file @
78e776a9
...
@@ -11,7 +11,7 @@ usage() {
...
@@ -11,7 +11,7 @@ usage() {
echo
"""
echo
"""
Usage: install.sh [options...]
Usage: install.sh [options...]
By default will install deepspeed and all third party dependecies ac
c
ross all machines listed in
By default will install deepspeed and all third party depende
n
cies across all machines listed in
hostfile (hostfile: /job/hostfile). If no hostfile exists, will only install locally
hostfile (hostfile: /job/hostfile). If no hostfile exists, will only install locally
[optional]
[optional]
...
@@ -45,6 +45,10 @@ while [[ $# -gt 0 ]]
...
@@ -45,6 +45,10 @@ while [[ $# -gt 0 ]]
do
do
key
=
"
$1
"
key
=
"
$1
"
case
$key
in
case
$key
in
-l
|
--local_only
)
local_only
=
1
;
shift
;;
-s
|
--pip_sudo
)
-s
|
--pip_sudo
)
pip_sudo
=
1
;
pip_sudo
=
1
;
shift
shift
...
@@ -69,7 +73,7 @@ case $key in
...
@@ -69,7 +73,7 @@ case $key in
-H
|
--hostfile
)
-H
|
--hostfile
)
hostfile
=
$2
hostfile
=
$2
if
[
!
-f
$2
]
;
then
if
[
!
-f
$2
]
;
then
echo
"User
provided hostfile does not exist at
$hostfile
, exiting"
echo
"User
-
provided hostfile does not exist at
$hostfile
, exiting"
exit
1
exit
1
fi
fi
shift
shift
...
@@ -80,7 +84,7 @@ case $key in
...
@@ -80,7 +84,7 @@ case $key in
exit
0
exit
0
;;
;;
*
)
*
)
echo
"Unkown argument(s)"
echo
"Unk
n
own argument(s)"
usage
usage
exit
1
exit
1
shift
shift
...
@@ -98,7 +102,7 @@ if [ "$allow_sudo" == "0" ]; then
...
@@ -98,7 +102,7 @@ if [ "$allow_sudo" == "0" ]; then
fi
fi
if
[
"
$ds_only
"
==
"1"
]
&&
[
"
$tp_only
"
==
"1"
]
;
then
if
[
"
$ds_only
"
==
"1"
]
&&
[
"
$tp_only
"
==
"1"
]
;
then
echo
"-d and -t are mutually exclusive, only choose one o
r none
"
echo
"-d and -t are mutually exclusive, only choose one o
f the two
"
usage
usage
exit
1
exit
1
fi
fi
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment