Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
default.yaml 357 Bytes
Newer Older
lintangsutawika's avatar
added rte  
lintangsutawika committed
1
2 
group:
  - super-glue-lm-eval-v1
lintangsutawika's avatar
add glue, renamed sglue's rte to sglue_rte  
lintangsutawika committed
3 
task: sglue_rte
lintangsutawika's avatar
added rte  
lintangsutawika committed
4
5
6
7
8 
dataset_path: super_glue
dataset_name: rte
output_type: multiple_choice
training_split: train
validation_split: validation
lintangsutawika's avatar
update on metrics and delet files  
lintangsutawika committed
9 
doc_to_text: "{{premise}}\nQuestion: {{hypothesis}} True or False?\nAnswer:"
lintangsutawika's avatar
added rte  
lintangsutawika committed
10
11
12
13 
doc_to_target: label
doc_to_choice: ['True', 'False']
metric_list:
  - metric: acc
lintangsutawika's avatar
add versions  
lintangsutawika committed
14 
metadata:
Hailey Schoelkopf's avatar
Correctly Print Task Versioning (#1173)  
Hailey Schoelkopf committed
15 
  version: 0.0