Skip to content

GitLab

"examples/pytorch/vscode:/vscode.git/clone" did not exist on "9497a9be85cf03e2a21e28159b59f51cba9d4aad"
Unverified Commit 007466e5 authored by Stas Bekman's avatar Stas Bekman Committed by GitHub
Browse files

[doc] xref to hostfile discussion (#604) 

* [doc] xref to hostfile discussion

wasn't clear where to find what was meant by `hostfile` - so adding a link to where it's discussed.

* remove whitespace
parent 9f8e8f38
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
docs/_pages/features.md
View file @ 007466e5
...@@ -28,7 +28,8 @@ deepspeed --hostfile=<hostfile> \ ...@@ -28,7 +28,8 @@ deepspeed --hostfile=<hostfile> \
<client_entry.py> <client args> \ <client_entry.py> <client args> \
--deepspeed --deepspeed_config ds_config.json --deepspeed --deepspeed_config ds_config.json
``` ```
The script `<client_entry.py>` will execute on the resources specified in `<hostfile>`. The script `<client_entry.py>` will execute on the resources specified in
[`<hostfile>`](/getting-started/#resource-configuration-multi-node).
## Pipeline Parallelism ## Pipeline Parallelism
DeepSpeed provides [pipeline parallelism](/tutorials/pipeline/) for memory- DeepSpeed provides [pipeline parallelism](/tutorials/pipeline/) for memory-
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment