Skip to content

GitLab

Commit a4ca4d2c authored by Baber's avatar Baber
Browse files

nit

parent 81f84653
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 0 deletions
lm_eval/tasks/gpqa/cot_n_shot/_gpqa_cot_n_shot_yaml
View file @ a4ca4d2c
...@@ -22,6 +22,8 @@ filter_list: ...@@ -22,6 +22,8 @@ filter_list:
ignore_case: true ignore_case: true
ignore_punctuation: true ignore_punctuation: true
regex_pattern: "(\\([A-Z]\\))" regex_pattern: "(\\([A-Z]\\))"
choices_field: "choices"
format_style: "parens"
- function: "take_first" - function: "take_first"
generation_kwargs: generation_kwargs:
until: until:
......
lm_eval/tasks/gpqa/generative/_gpqa_generative_n_shot_yaml
View file @ a4ca4d2c
...@@ -22,6 +22,8 @@ filter_list: ...@@ -22,6 +22,8 @@ filter_list:
ignore_case: true ignore_case: true
ignore_punctuation: true ignore_punctuation: true
regex_pattern: "(\\([A-Z]\\))" regex_pattern: "(\\([A-Z]\\))"
choices_field: "choices"
format_style: "parens"
- function: "take_first" - function: "take_first"
generation_kwargs: generation_kwargs:
until: until:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment