Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
bc5c554d
Commit
bc5c554d
authored
Feb 06, 2025
by
Baber
Browse files
fix
parent
c9800d20
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
lm_eval/tasks/ai2d/ai2d.yaml
lm_eval/tasks/ai2d/ai2d.yaml
+1
-1
No files found.
lm_eval/tasks/ai2d/ai2d.yaml
View file @
bc5c554d
...
...
@@ -18,7 +18,7 @@ filter_list:
-
name
:
"
strict-match"
filter
:
-
function
:
"
regex"
regex_pattern
:
"
(?:[`
\\
*_]*(?:FINAL
ANSWER|Final
Answer)[`
\\
*_]*)[:
\\
s]*[`
\\
*_]*([A-D])[`
\\
*_]*"
regex_pattern
:
"
(?:[`
\\
*_]*(?
i
:FINAL
ANSWER|Final
Answer|
Answer)[`
\\
*_]*)[:
\\
s]*[`
\\
*_]*([A-D])[`
\\
*_]*"
-
function
:
"
take_first"
metric_list
:
-
metric
:
exact_match
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment