official/bert/run_pretraining.py · c92a7e169f03c8672a21e6c2172bc8e5d174115b · ModelZoo / ResNet50_tensorflow

Merged commit includes the following changes: (#7347) · c92a7e16

Hongkun Yu authored Jul 31, 2019

260862396  by A. Unique TensorFlower<gardener@tensorflow.org>:

    Fix BERT pretraining input pipeline to shuffle and shard dataset properly for multi-worker training.

--

PiperOrigin-RevId: 260862396

c92a7e16

run_pretraining.py 7.33 KB

Replace run_pretraining.py