Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
_template_yaml 369 Bytes
Newer Older
lintangsutawika's avatar
add blimp  
lintangsutawika committed
1
2 
dataset_path: blimp
output_type: multiple_choice
Lintang Sutawika's avatar
Patch Blimp  
Lintang Sutawika committed
3 
validation_split: train
lintangsutawika's avatar
add blimp  
lintangsutawika committed
4
5
6 
doc_to_text: ""
doc_to_target: 0
doc_to_choice: "{{[sentence_good, sentence_bad]}}"
lintangsutawika's avatar
renamed template file to make it easier to search  
lintangsutawika committed
7 
num_fewshot: 0
lintangsutawika's avatar
add blimp  
lintangsutawika committed
8
9
10
11 
should_decontaminate: true
doc_to_decontamination_query: "{{sentence_good}} {{sentence_bad}}"
metric_list:
  - metric: acc
James A. Michaelov's avatar
set aggregation and higher_is_better (instead of falling back on defaults) (#2692)  
James A. Michaelov committed
12
13 
    aggregation: mean
    higher_is_better: true
lintangsutawika's avatar
add versions  
lintangsutawika committed
14 
metadata:
Hailey Schoelkopf's avatar
Correctly Print Task Versioning (#1173)  
Hailey Schoelkopf committed
15 
  version: 1.0