Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
apex
Commits
8ab5e470
"vscode:/vscode.git/clone" did not exist on "1d7d92cb10c18b750a86acd0d971d114c34a40c4"
Unverified
Commit
8ab5e470
authored
Mar 14, 2019
by
mcarilli
Committed by
GitHub
Mar 14, 2019
Browse files
Update README.md
parent
a730f38f
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
examples/simple/distributed/README.md
examples/simple/distributed/README.md
+1
-1
No files found.
examples/simple/distributed/README.md
View file @
8ab5e470
...
...
@@ -3,7 +3,7 @@
[
torch.nn.parallel.DistributedDataParallel
](
https://pytorch.org/docs/stable/nn.html#distributeddataparallel
)
and the Pytorch multiprocess launcher script,
[
torch.distributed.launch
](
https://pytorch.org/docs/master/distributed.html#launch-utility
)
.
The use of
`Amp`
with
d
istributed does not need to change from ordinary
The use of
`Amp`
with
D
istributed
DataParallel
does not need to change from ordinary
single-process use. The only gotcha is that wrapping your model with
`DistributedDataParallel`
must
come after the call to
`amp.initialize`
. Test via
```
bash
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment