Skip to content

GitLab

"...resnet50_tensorflow.git" did not exist on "c57e975a4ad91ed6dc4bfed21927fce85b1dc545"
Commit e2293a97 authored by Jing Li's avatar Jing Li Committed by A. Unique TensorFlower
Browse files

Relax the max accuracy threshold for BERT Squad v1.1 task. 

PiperOrigin-RevId: 269689809
parent 999fde28
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
official/bert/benchmark/bert_squad_benchmark.py
View file @ e2293a97
...@@ -356,7 +356,7 @@ class BertSquadAccuracy(BertSquadBenchmarkBase): ...@@ -356,7 +356,7 @@ class BertSquadAccuracy(BertSquadBenchmarkBase):
stats=summary, stats=summary,
wall_time_sec=wall_time_sec, wall_time_sec=wall_time_sec,
min_accuracy=0.900, min_accuracy=0.900,
max_accuracy=0.908) max_accuracy=0.920)
def benchmark_1_gpu_eager(self): def benchmark_1_gpu_eager(self):
"""Tests BERT SQuAD model accuracy with 1 GPU with eager execution.""" """Tests BERT SQuAD model accuracy with 1 GPU with eager execution."""
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment