Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
_mmlu_stem.yaml 194 Bytes
Newer Older
Lintang Sutawika's avatar
Group agg rework (#1741)  
Lintang Sutawika committed
1
2
3
4
5
6
7 
group: mmlu_stem
group_alias: stem
task:
  - mmlu_stem_tasks
aggregate_metric_list:
  - metric: acc
    weight_by_size: True
Baber's avatar
changed mmlu to cloze and added arc_challenge_mmlu  
Baber committed
8
9 
  - metric: acc_norm
    weight_by_size: True
Lintang Sutawika's avatar
Group agg rework (#1741)  
Lintang Sutawika committed
10 
metadata:
Jungwhan Kim's avatar
keep new line for task description (#2116)  
Jungwhan Kim committed
11 
  version: 2