GitLab

Sometimes it takes longer than 15 seconds, and even longer than 1 minute, to spawn and create the alive file.

* adding implementation of https://arxiv.org/abs/1805.06066

* fixing typos and sentences in README

General guidelines for Google Python Style Guide links to a deprecated style guide from google

Fix several Markdown links in slim README

Updating fivo codebase

Move tf.cast to tf.float16 in input pipeline 

* Fix spurious "did not start correctly" error.

The error "Generation subprocess did not start correctly" would occur if the async process started up after the main process checked for the subproc_alive file.

* Add error message

When constructing the evaluation records, data_async_generation.py would copy the records into the final directory. The main process would wait until the eval records existed. However, the main process would sometimes read the eval records before they were fully copied, causing a DataLossError.

Update resnet defaults v1

ResNet synthetic data performance enhancement.

Added fused_batch_norm parameter

Bypassing Export model step, if training on TPU's. As this need inference to be supported on TPU's. Remove this check once inference is supported. (#5209)

minor bug fix

Fix list format and typos in save and restore tutorial.

* Add distribution strategy to keras benchmark

* Fix comments

* Fix lints

* Fix bug on distributed training in mnist using MirroredStrategy API

* Remove unnecessary codes and chagne distribution strategy source
- Remove multi-gpu
- Remove TowerOptimizer
- Change from MirroredStrategy to distribution_utils.get_distribution_strategy

* Make ResNet robust to the case that epochs_between_evals does not divide train_epochs, and add an --eval_only option

* add some comments to make the control flow easier to follow

* address PR comments