Skip to content

GitLab

Commit 7601d828 authored by lintangsutawika's avatar lintangsutawika
Browse files

edit to fix cot filter

parent 8c39bfc7
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
lm_eval/tasks/bbh/flan_cot_fewshot/_flan_cot_fewshot_template_yaml
View file @ 7601d828
...@@ -18,5 +18,5 @@ filter_list: ...@@ -18,5 +18,5 @@ filter_list:
- name: "get-answer" - name: "get-answer"
filter: filter:
- function: "regex" - function: "regex"
regex_pattern: "(?<=The answer is )(.*)(?=.)" regex_pattern: "(?<=the answer is )(.*)(?=.)"
- function: "take_first" - function: "take_first"
\ No newline at end of file
lm_eval/tasks/bbh/flan_cot_zeroshot/_flan_cot_zeroshot_template_yaml
View file @ 7601d828
...@@ -18,5 +18,5 @@ filter_list: ...@@ -18,5 +18,5 @@ filter_list:
- name: "get-answer" - name: "get-answer"
filter: filter:
- function: "regex" - function: "regex"
regex_pattern: "(?<=The answer is )(.*)(?=.)" regex_pattern: "(?<=the answer is )(.*)(?=.)"
- function: "take_first" - function: "take_first"
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment