Commit 765da424 authored by Reed Wanderman-Milne's avatar Reed Wanderman-Milne Committed by A. Unique TensorFlower
Browse files

Fix bug where dynamic loss scaling was broken

PiperOrigin-RevId: 266376708
parent f9fe0fe9
......@@ -209,11 +209,6 @@ def define_performance(num_parallel_calls=False, inter_op=False, intra_op=False,
flags_dict["dtype"] != "fp16"):
raise flags.ValidationError("--fp16_implementation should not be "
"specified unless --dtype=fp16")
if (flags_dict["fp16_implementation"] != "graph_rewrite" and
flags_dict["loss_scale"] == "dynamic"):
raise flags.ValidationError("--loss_scale=dynamic is only supported "
"when "
"--fp16_implementation=graph_rewrite")
return True
if all_reduce_alg:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment