Relax the max accuracy threshold for BERT Squad v1.1 task.

PiperOrigin-RevId: 269689809

Relax the max accuracy threshold for BERT Squad v1.1 task.
PiperOrigin-RevId: 269689809
e2293a97 · Jing Li · A. Unique TensorFlower · 999fde28 · e2293a97
Commit e2293a97 authored Sep 17, 2019 by Jing Li Committed by A. Unique TensorFlower Sep 17, 2019
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

official/bert/benchmark/bert_squad_benchmark.py official/bert/benchmark/bert_squad_benchmark.py +1 -1

No files found.
--- a/official/bert/benchmark/bert_squad_benchmark.py
+++ b/official/bert/benchmark/bert_squad_benchmark.py
@@ -356,7 +356,7 @@ class BertSquadAccuracy(BertSquadBenchmarkBase):
        stats=summary,
        wall_time_sec=wall_time_sec,
        min_accuracy=0.900,
-        max_accuracy=0.908)
+        max_accuracy=0.920)

  def benchmark_1_gpu_eager(self):
    """Tests BERT SQuAD model accuracy with 1 GPU with eager execution."""