Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
AraDiCE_ArabicMMLU.yaml 317 Bytes
Newer Older
Firoj Alam, Scientist, QCRI's avatar
AraDICE task config file (#2507)  
Firoj Alam, Scientist, QCRI committed
1
2
3
4
5
6
7
8
9
10
11
12 
group: AraDiCE_ArabicMMLU_lev
task:
- AraDiCE_ArabicMMLU_humanities_lev
- AraDiCE_ArabicMMLU_language_lev
- AraDiCE_ArabicMMLU_social-science_lev
- AraDiCE_ArabicMMLU_stem_lev
- AraDiCE_ArabicMMLU_other_lev
aggregate_metric_list:
  - metric: acc
    weight_by_size: True
  - metric: acc_norm
    weight_by_size: True