Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
_mmlu.yaml 175 Bytes
Newer Older
lintangsutawika's avatar
modfied to add subcategory  
lintangsutawika committed
1
2
3
4
5
6 
group: mmlu
task:
  - mmlu_stem
  - mmlu_other
  - mmlu_social_sciences
  - mmlu_humanities
lintangsutawika's avatar
add a group config that allows disabling table for group score and group aggregate in general  
lintangsutawika committed
7
8
9
10 
group_config:
  aggregate_metric: True
  aggregate_fn: mean
  weight_by_size: True