Skip to content

GitLab

Commit c9800d20 authored by Baber's avatar Baber
Browse files

fix

parent 9fa5126a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
lm_eval/tasks/ai2d/ai2d.yaml
View file @ c9800d20
......@@ -21,7 +21,7 @@ filter_list:
regex_pattern: "(?:[`\\*_]*(?:FINAL ANSWER|Final Answer)[`\\*_]*)[:\\s]*[`\\*_]*([A-D])[`\\*_]*"
- function: "take_first"
metric_list:
- metric: acc
- metric: exact_match
aggregation: mean
higher_is_better: true
metadata:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment