Skip to content

GitLab

Commit c9800d20 authored by Baber's avatar Baber
Browse files

fix

parent 9fa5126a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
lm_eval/tasks/ai2d/ai2d.yaml
View file @ c9800d20
...@@ -21,7 +21,7 @@ filter_list: ...@@ -21,7 +21,7 @@ filter_list:
regex_pattern: "(?:[`\\*_]*(?:FINAL ANSWER|Final Answer)[`\\*_]*)[:\\s]*[`\\*_]*([A-D])[`\\*_]*" regex_pattern: "(?:[`\\*_]*(?:FINAL ANSWER|Final Answer)[`\\*_]*)[:\\s]*[`\\*_]*([A-D])[`\\*_]*"
- function: "take_first" - function: "take_first"
metric_list: metric_list:
- metric: acc - metric: exact_match
aggregation: mean aggregation: mean
higher_is_better: true higher_is_better: true
metadata: metadata:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment