Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
668603fc
Commit
668603fc
authored
Jan 02, 2025
by
Baber
Browse files
add all the different translations of `Answer` to regex
parent
6a72f627
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
lm_eval/tasks/llama3/instruct/mgsm_chat.yaml
lm_eval/tasks/llama3/instruct/mgsm_chat.yaml
+2
-2
No files found.
lm_eval/tasks/llama3/instruct/mgsm_chat.yaml
View file @
668603fc
...
...
@@ -31,13 +31,13 @@ filter_list:
-
name
:
"
strict-match"
filter
:
-
function
:
"
regex"
regex_pattern
:
"
Answer:
(
\\
-?[0-9
\\
.
\\
,]+)"
regex_pattern
:
"
(?:
Answer
|Réponse|Antwort|Ответ|Respuesta|答え|Jibu|答案|คำตอบ|సమాధానం|উত্তর)
:
(
\\
-?[0-9
\\
.
\\
,]+)"
-
function
:
"
take_first"
-
name
:
"
flexible-extract"
filter
:
-
function
:
regex
group_select
:
-1
regex_pattern
:
"
Answer:
(-?[$0-9.,]{2,})|(-?[0-9]+)"
regex_pattern
:
"
(?:
Answer
|Réponse|Antwort|Ответ|Respuesta|答え|Jibu|答案|คำตอบ|సమాధానం|উত্তর)
:
(-?[$0-9.,]{2,})|(-?[0-9]+)"
-
function
:
take_first
-
function
:
remove_whitespace
-
function
:
take_first
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment