Skip to content

GitLab

Unverified Commit c5dbd487 authored by josh11b's avatar josh11b Committed by GitHub
Browse files

Update distribution_utils.py

parent 6c560cb3
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 2 deletions
official/utils/misc/distribution_utils.py
View file @ c5dbd487
...@@ -27,8 +27,9 @@ def get_distribution_strategy(num_gpus, all_reduce_alg=None): ...@@ -27,8 +27,9 @@ def get_distribution_strategy(num_gpus, all_reduce_alg=None):
Args: Args:
num_gpus: Number of GPUs to run this model. num_gpus: Number of GPUs to run this model.
all_reduce_alg: Specify which algorithm to use when performing all-reduce. all_reduce_alg: Specify which algorithm to use when performing all-reduce.
See tf.contrib.distribute.AllReduceCrossDeviceOps for available algorithms. See tf.contrib.distribute.AllReduceCrossDeviceOps for available
If None, DistributionStrategy will choose based on device topology. algorithms. If None, DistributionStrategy will choose based on device
topology.
Returns: Returns:
tf.contrib.distribute.DistibutionStrategy object. tf.contrib.distribute.DistibutionStrategy object.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment