Commit e408c2ce authored by haileyschoelkopf's avatar haileyschoelkopf
Browse files

make 'bbh' a group name for flan cot 3-shot, add stopseqs

parent b189066d
group: bbh_flan_cot_fewshot
group:
- bbh_flan_cot_fewshot
- bbh
dataset_path: lukaemon/bbh
output_type: generate_until
test_split: test
......@@ -12,6 +14,8 @@ metric_list:
generation_kwargs:
until:
- "</s>"
- "Q"
- "\n\n"
do_sample: false
temperature: 0.0
filter_list:
......
......@@ -12,6 +12,8 @@ metric_list:
generation_kwargs:
until:
- "</s>"
- "Q"
- "\n\n"
do_sample: false
temperature: 0.0
filter_list:
......
......@@ -12,5 +12,7 @@ metric_list:
generation_kwargs:
until:
- "</s>"
- "Q"
- "\n\n"
do_sample: false
temperature: 0.0
......@@ -12,5 +12,7 @@ metric_list:
generation_kwargs:
until:
- "</s>"
- "Q:"
- "\n\n"
do_sample: false
temperature: 0.0
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment