Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
default.yaml 317 Bytes
Newer Older
lintangsutawika's avatar
adjustments on import origin  
lintangsutawika committed
1
2 
group:
  - super-glue-lm-eval-v1
lintangsutawika's avatar
rename boolq task name for testing  
lintangsutawika committed
3 
task: "boolq"
lintangsutawika's avatar
adjustments on import origin  
lintangsutawika committed
4
5
6
7
8
9 
dataset_path: super_glue
dataset_name: boolq
output_type: multiple_choice
training_split: train
validation_split: validation
doc_to_text: "{{passage}}\nQuestion: {{question}}\nAnswer:"
lintangsutawika's avatar
process update to process doc_to_target variety  
lintangsutawika committed
10
11 
doc_to_target: label
doc_to_choice: {0: "no", 1: "yes"}
lintangsutawika's avatar
rename boolq task name for testing  
lintangsutawika committed
12 
metric_list:
lintangsutawika's avatar
process update to process doc_to_target variety  
lintangsutawika committed
13 
  - metric: acc