Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
bceca7ce
Unverified
Commit
bceca7ce
authored
May 22, 2024
by
Israel Abebe
Committed by
GitHub
May 22, 2024
Browse files
Update translate_direct_yaml
parent
21fbd5b2
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
12 additions
and
7 deletions
+12
-7
lm_eval/tasks/afrimgsm/translate_direct/translate_direct_yaml
...val/tasks/afrimgsm/translate_direct/translate_direct_yaml
+12
-7
No files found.
lm_eval/tasks/afrimgsm/translate_direct/translate_direct_yaml
View file @
bceca7ce
...
@@ -13,17 +13,22 @@ generation_kwargs:
...
@@ -13,17 +13,22 @@ generation_kwargs:
do_sample: false
do_sample: false
temperature: 0.0
temperature: 0.0
target_delimiter: " "
target_delimiter: " "
filter_list:
- name: remove_whitespace
filter:
- function: remove_whitespace
- function: take_first
- filter:
- function: regex
group_select: -1
regex_pattern: (-?[$0-9.,]{2,})|(-?[0-9]+)
- function: take_first
name: flexible-extract
metric_list:
metric_list:
- metric: exact_match
- metric: exact_match
aggregation: mean
aggregation: mean
higher_is_better: true
higher_is_better: true
ignore_case: true
ignore_case: true
ignore_punctuation: true
ignore_punctuation: true
filter_list:
- name: "get-answer"
filter:
- function: "regex"
regex_pattern: "The answer is (\\-?[0-9\\.\\,]+)"
- function: "take_first"
metadata:
metadata:
version:
3
.0
version:
2
.0
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment