Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
_template_yaml 371 Bytes
Newer Older
James A. Michaelov's avatar
Add BLiMP-NL (#3221)  
James A. Michaelov committed
1
2
3
4
5
6
7
8
9
10
11
12 
dataset_path: jmichaelov/blimp_nl
output_type: multiple_choice
test_split: test
doc_to_text: ""
target_delimiter: ""
doc_to_target: 0
doc_to_choice: "{{[sentence_good, sentence_bad]}}"
num_fewshot: 0
metric_list:
  - metric: acc
    aggregation: mean
    higher_is_better: true
James A. Michaelov's avatar
Add `acc_norm` to BLiMP-NL (#3272)  
James A. Michaelov committed
13
14
15 
  - metric: acc_norm
    aggregation: mean
    higher_is_better: true
James A. Michaelov's avatar
Add BLiMP-NL (#3221)  
James A. Michaelov committed
16
17 
metadata:
  version: 0