Skip to content

GitLab

"configs/vscode:/vscode.git/clone" did not exist on "7f3a16a3e30267d90aa911e5714686b7112da0a6"
Unverified Commit f378f306 authored by Baber Abbasi's avatar Baber Abbasi Committed by GitHub
Browse files

load metric with `evaluate` (#2351)

parent bc50a9aa
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 1 deletion
lm_eval/tasks/squadv2/task.py
View file @ f378f306
...@@ -37,7 +37,9 @@ _CITATION = """ ...@@ -37,7 +37,9 @@ _CITATION = """
def _squad_metric(predictions, references): def _squad_metric(predictions, references):
squad_metric = datasets.load_metric("squad_v2") import evaluate
squad_metric = evaluate.load("squad_v2")
return squad_metric.compute(predictions=predictions, references=references) return squad_metric.compute(predictions=predictions, references=references)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment