Skip to content

GitLab

Commit 3183fd02 authored by Xianzhi Du's avatar Xianzhi Du Committed by A. Unique TensorFlower
Browse files

Internal change 

PiperOrigin-RevId: 397350737
parent 1dc12711
Show whitespace changes
Inline Side-by-side
Showing with 5 additions and 8 deletions
official/vision/beta/configs/experiments/image_classification/imagenet_resnet50_tpu.yaml
View file @ 3183fd02
# ResNet-50 ImageNet classification. 78.1% top-1 and 93.9% top-5 accuracy.
runtime: runtime:
distribution_strategy: 'tpu' distribution_strategy: 'tpu'
mixed_precision_dtype: 'bfloat16' mixed_precision_dtype: 'bfloat16'
...@@ -10,8 +9,6 @@ task: ...@@ -10,8 +9,6 @@ task:
type: 'resnet' type: 'resnet'
resnet: resnet:
model_id: 50 model_id: 50
norm_activation:
activation: 'swish'
losses: losses:
l2_weight_decay: 0.0001 l2_weight_decay: 0.0001
one_hot: true one_hot: true
...@@ -28,7 +25,7 @@ task: ...@@ -28,7 +25,7 @@ task:
dtype: 'bfloat16' dtype: 'bfloat16'
drop_remainder: false drop_remainder: false
trainer: trainer:
train_steps: 62400 train_steps: 28080
validation_steps: 13 validation_steps: 13
validation_interval: 312 validation_interval: 312
steps_per_loop: 312 steps_per_loop: 312
...@@ -40,10 +37,10 @@ trainer: ...@@ -40,10 +37,10 @@ trainer:
sgd: sgd:
momentum: 0.9 momentum: 0.9
learning_rate: learning_rate:
type: 'cosine' type: 'stepwise'
cosine: stepwise:
initial_learning_rate: 1.6 boundaries: [9360, 18720, 24960]
decay_steps: 62400 values: [1.6, 0.16, 0.016, 0.0016]
warmup: warmup:
type: 'linear' type: 'linear'
linear: linear:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment