decay changed 2e-4 and batch_norm_decay .997

- Average of 5 runs single gpu is 93%+ range 92.5 to 93.4 top_1

decay changed 2e-4 and batch_norm_decay .997
- Average of 5 runs single gpu is 93%+ range 92.5 to 93.4 top_1
8d5c1684 · Toby Boyd · b83f1e88 · 8d5c1684
Commit 8d5c1684 authored Dec 23, 2018 by Toby Boyd
Show whitespace changes
Inline Side-by-side

Showing with 2 additions and 2 deletions

official/resnet/keras/resnet_cifar_model.py official/resnet/keras/resnet_cifar_model.py +2 -2

No files found.
--- a/official/resnet/keras/resnet_cifar_model.py
+++ b/official/resnet/keras/resnet_cifar_model.py
@@ -28,9 +28,9 @@ import warnings
 import tensorflow as tf


-BATCH_NORM_DECAY = 0.9
+BATCH_NORM_DECAY = 0.997
 BATCH_NORM_EPSILON = 1e-5
-L2_WEIGHT_DECAY = 1e-4
+L2_WEIGHT_DECAY = 2e-4


 def _obtain_input_shape(input_shape,