Skip to content

GitLab

"git@developer.sourcefind.cn:lacacy/qwen_lmdeploy.git" did not exist on "327deaee4122b3ff7780e36d0e481c5997dbe1fa"
Commit 765da424 authored by Reed Wanderman-Milne's avatar Reed Wanderman-Milne Committed by A. Unique TensorFlower
Browse files

Fix bug where dynamic loss scaling was broken 

PiperOrigin-RevId: 266376708
parent f9fe0fe9
Show whitespace changes
Inline Side-by-side
Showing with 0 additions and 5 deletions
official/utils/flags/_performance.py
View file @ 765da424
...@@ -209,11 +209,6 @@ def define_performance(num_parallel_calls=False, inter_op=False, intra_op=False, ...@@ -209,11 +209,6 @@ def define_performance(num_parallel_calls=False, inter_op=False, intra_op=False,
flags_dict["dtype"] != "fp16"): flags_dict["dtype"] != "fp16"):
raise flags.ValidationError("--fp16_implementation should not be " raise flags.ValidationError("--fp16_implementation should not be "
"specified unless --dtype=fp16") "specified unless --dtype=fp16")
if (flags_dict["fp16_implementation"] != "graph_rewrite" and
flags_dict["loss_scale"] == "dynamic"):
raise flags.ValidationError("--loss_scale=dynamic is only supported "
"when "
"--fp16_implementation=graph_rewrite")
return True return True
if all_reduce_alg: if all_reduce_alg:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment