Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
_mmlu.yaml 154 Bytes
Newer Older
lintangsutawika's avatar
modfied to add subcategory  
lintangsutawika committed
1
2
3
4
5
6 
group: mmlu
task:
  - mmlu_stem
  - mmlu_other
  - mmlu_social_sciences
  - mmlu_humanities
lintangsutawika's avatar
add a group config that allows disabling table for group score and group aggregate in general  
lintangsutawika committed
7
8
9 
group_config:
  aggregate_metric: True
  weight_by_size: True