Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
greedy_until_template_yaml 295 Bytes
Newer Older
lintangsutawika's avatar
add bigbench  
lintangsutawika committed
1 
group: bigbench
haileyschoelkopf's avatar
update generate_tasks.py and template yamls  
haileyschoelkopf committed
2 
dataset_path: hails/bigbench
lintangsutawika's avatar
add bigbench  
lintangsutawika committed
3 
output_type: greedy_until
haileyschoelkopf's avatar
update generate_tasks.py and template yamls  
haileyschoelkopf committed
4 
test_split: default
lintangsutawika's avatar
add bigbench  
lintangsutawika committed
5
6
7
8
9
10
11
12
13 
doc_to_text: inputs
doc_to_target: "{{targets[0]}}"
generation_kwargs:
  max_length: 128
metric_list:
  - metric: exact_match
    aggregation: mean
    higher_is_better: true
    ignore_punctuation: true