Skip to content

GitLab

"git@developer.sourcefind.cn:gaoqiong/migraphx.git" did not exist on "f47a39ea7ae8fd160c7cf7e1d2c945bb8f4c52bc"
Unverified Commit 94328ebe authored by Lintang Sutawika's avatar Lintang Sutawika Committed by GitHub
Browse files

Update cot_yaml

parent a916afd7
Hide whitespace changes
Inline Side-by-side
Showing with 6 additions and 1 deletion
lm_eval/tasks/mgsm/native_cot/cot_yaml
View file @ 94328ebe
...@@ -14,10 +14,15 @@ generation_kwargs: ...@@ -14,10 +14,15 @@ generation_kwargs:
- "\n" - "\n"
do_sample: false do_sample: false
temperature: 0.0 temperature: 0.0
target_delimiter: " "
metric_list: metric_list:
- metric: exact_match - metric: exact_match
aggregation: mean aggregation: mean
higher_is_better: true higher_is_better: true
ignore_case: true ignore_case: true
ignore_punctuation: true ignore_punctuation: true
filter_list:
- name: "get-answer"
filter:
- function: "regex"
regex_pattern: "The answer is (\\-?[0-9\\.\\,]+)"
- function: "take_first"
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment