Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
default.yaml 359 Bytes
Newer Older
Lintang Sutawika's avatar
Group agg rework (#1741)  
Lintang Sutawika committed
1 
tag:
lintangsutawika's avatar
added rte  
lintangsutawika committed
2 
  - super-glue-lm-eval-v1
lintangsutawika's avatar
add glue, renamed sglue's rte to sglue_rte  
lintangsutawika committed
3 
task: sglue_rte
Baber's avatar
remove doc_to_choice from `boolq-seq2seq`  
Baber committed
4 
dataset_path: aps/super_glue
lintangsutawika's avatar
added rte  
lintangsutawika committed
5
6
7
8 
dataset_name: rte
output_type: multiple_choice
training_split: train
validation_split: validation
lintangsutawika's avatar
update on metrics and delet files  
lintangsutawika committed
9 
doc_to_text: "{{premise}}\nQuestion: {{hypothesis}} True or False?\nAnswer:"
lintangsutawika's avatar
added rte  
lintangsutawika committed
10 
doc_to_target: label
Baber's avatar
remove doc_to_choice from `boolq-seq2seq`  
Baber committed
11 
doc_to_choice: ["True", "False"]
lintangsutawika's avatar
added rte  
lintangsutawika committed
12
13 
metric_list:
  - metric: acc
lintangsutawika's avatar
add versions  
lintangsutawika committed
14 
metadata:
Hailey Schoelkopf's avatar
Correctly Print Task Versioning (#1173)  
Hailey Schoelkopf committed
15 
  version: 0.0