Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
_mmlu.yaml 147 Bytes
Newer Older
lintangsutawika's avatar
modfied to add subcategory  
lintangsutawika committed
1
2
3
4
5
6 
group: mmlu
task:
  - mmlu_stem
  - mmlu_other
  - mmlu_social_sciences
  - mmlu_humanities
lintangsutawika's avatar
adjust args  
lintangsutawika committed
7
8 
aggregate_metric: True
weight_by_size: True
lintangsutawika's avatar
update to work with new group and task configuration  
lintangsutawika committed
9 
version: 1