Commit 559141e8 authored by Michael Carilli's avatar Michael Carilli
Browse files

Reformatting

parent 034b8f02
...@@ -69,13 +69,7 @@ class Reducer(object): ...@@ -69,13 +69,7 @@ class Reducer(object):
main_reducer.py in https://github.com/NVIDIA/apex/tree/master/examples/imagenet shows example usage. main_reducer.py in https://github.com/NVIDIA/apex/tree/master/examples/imagenet shows example usage.
Args: Args:
module_or_grads_list: Either a network definition (module) being run in module_or_grads_list: Either a network definition (module) being run in multi-gpu/distributed mode, or an iterable of gradients to be reduced. If a module is passed in, the Reducer constructor will sync the parameters across processes (broadcasting from rank 0) to make sure they're all initialized with the same values. If a list of gradients (that came from some module) is passed in, the user is responsible for manually syncing that module's parameters at the beginning of training.
multi-gpu/distributed mode, or an iterable of gradients to be reduced.
If a module is passed in, the Reducer constructor will sync the parameters across processes
(broadcasting from rank 0) to make sure they're all initialized with the same values.
If a list of gradients (that came from some module)
is passed in, the user is responsible for manually syncing that module's parameters
at the beginning of training.
""" """
def __init__(self, module_or_grads_list): def __init__(self, module_or_grads_list):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment