Skip to content

GitLab

"lm_eval/tasks/afrixnli/en_direct.sh" did not exist on "187ab735b476d1195dbfdad098c48494569defda"
Switch branch/tag
Find file Normal viewHistoryPermalink
_mmlu_other.yaml 146 Bytes
Newer Older
lintangsutawika's avatar
update mmlu  
lintangsutawika committed
1
2
3
4 
group: mmlu_other
group_alias: other
task:
  - mmlu_other_tasks
lintangsutawika's avatar
update aggregate_metric arg  
lintangsutawika committed
5
6
7
8 
aggregate_metric:
  - metric: acc
    weight_by_size: True
metadata:
lintangsutawika's avatar
update format  
lintangsutawika committed
9 
  version: 1