Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
_mmlu.yaml 179 Bytes
Newer Older
lintangsutawika's avatar
modfied to add subcategory  
lintangsutawika committed
1
2 
group: mmlu
task:
lintangsutawika's avatar
update mmlu  
lintangsutawika committed
3
4
5
6 
  - mmlu_stem
  - mmlu_other
  - mmlu_social_sciences
  - mmlu_humanities
haileyschoelkopf's avatar
add many explicit group configs  
haileyschoelkopf committed
7 
aggregate_metric_list:
lintangsutawika's avatar
update aggregate_metric arg  
lintangsutawika committed
8
9 
  - metric: acc
    weight_by_size: True
lintangsutawika's avatar
update mmlu/  
lintangsutawika committed
10
11 
metadata:
  version: 1