Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
agieval_cn.yaml 422 Bytes
Newer Older
Lintang Sutawika's avatar
Group agg rework (#1741)  
Lintang Sutawika committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19 
group: agieval_cn
task:
  - agieval_gaokao_biology
  - agieval_gaokao_chemistry
  - agieval_gaokao_chinese
  - agieval_gaokao_geography
  - agieval_gaokao_history
  - agieval_gaokao_mathcloze
  - agieval_gaokao_mathqa
  - agieval_gaokao_physics
  - agieval_jec_qa_ca
  - agieval_jec_qa_kd
  - agieval_logiqa_zh
aggregate_metric_list:
  - metric: acc
    aggregation: mean
    weight_by_size: true
metadata:
  version: 0.0