Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
apex
Commits
bfa3e0ee
Commit
bfa3e0ee
authored
Jun 22, 2018
by
Michael Carilli
Browse files
Adding simple example links for distributed
parent
adaa9137
Changes
4
Show whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
21 additions
and
3 deletions
+21
-3
apex/parallel/README.md
apex/parallel/README.md
+3
-1
examples/FP16_Optimizer_simple/distributed_apex/README.md
examples/FP16_Optimizer_simple/distributed_apex/README.md
+7
-0
examples/FP16_Optimizer_simple/distributed_pytorch/README.md
examples/FP16_Optimizer_simple/distributed_pytorch/README.md
+7
-0
examples/distributed/README.md
examples/distributed/README.md
+4
-2
No files found.
apex/parallel/README.md
View file @
bfa3e0ee
...
...
@@ -10,6 +10,8 @@ multiproc.py contains the source code for `apex.parallel.multiproc`, a launch ut
#### [Example/Walkthrough](https://github.com/NVIDIA/apex/tree/master/examples/distributed)
#### [Imagenet Example w/Mixed Precision](https://github.com/NVIDIA/apex/tree/master/examples/imagenet)
#### [Imagenet example with Mixed Precision](https://github.com/NVIDIA/apex/tree/master/examples/imagenet)
#### [Simple example with FP16_Optimizer](https://github.com/NVIDIA/apex/tree/master/examples/FP16_Optimizer_simple/distributed_apex)
examples/FP16_Optimizer_simple/distributed_apex/README.md
0 → 100644
View file @
bfa3e0ee
**distributed_data_parallel.py**
shows an example using
`FP16_Optimizer`
with
`apex.parallel.DistributedDataParallel`
.
The usage of
`FP16_Optimizer`
with distributed does not need to change from ordinary
single-process usage. Test via
```
bash
bash run.sh
```
examples/FP16_Optimizer_simple/distributed_pytorch/README.md
0 → 100644
View file @
bfa3e0ee
**distributed_data_parallel.py**
shows an example using
`FP16_Optimizer`
with
`torch.nn.parallel.DistributedDataParallel`
.
The usage of
`FP16_Optimizer`
with distributed does not need to change from ordinary
single-process usage. Test via
```
bash
bash run.sh
```
examples/distributed/README.md
View file @
bfa3e0ee
#
Basic
Multiprocess Example based on pytorch/examples/mnist
# Multiprocess Example based on pytorch/examples/mnist
main.py demonstrates how to modify a simple model to enable multiprocess distributed data parallel
training using the module wrapper
`apex.parallel.DistributedDataParallel`
...
...
@@ -17,7 +17,9 @@ transfers to reduce the total number of transfers required.
#### [Source Code](https://github.com/NVIDIA/apex/tree/master/apex/parallel)
#### [Another Example: Imagenet with mixed precision](https://github.com/NVIDIA/apex/tree/master/examples/imagenet)
#### [Another example: Imagenet with mixed precision](https://github.com/NVIDIA/apex/tree/master/examples/imagenet)
#### [Simple example with FP16_Optimizer](https://github.com/NVIDIA/apex/tree/master/examples/FP16_Optimizer_simple/distributed_apex)
## Getting started
Prior to running please run
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment