Skip to content

GitLab

"lm_eval/tasks/mmlu/generative/mmlu_miscellaneous.yaml" did not exist on "b043b05030b20a7e13177a4a0cc3607ddc059d86"
Switch branch/tag
Find file Normal viewHistoryPermalink
_leaderboard_gpqa.yaml 206 Bytes
Newer Older
Lintang Sutawika's avatar
Group agg rework (#1741)  
Lintang Sutawika committed
1
2
3
4
5 
group: leaderboard_gpqa
task:
  - leaderboard_gpqa_diamond
  - leaderboard_gpqa_extended
  - leaderboard_gpqa_main
Baber Abbasi's avatar
leaderboard - add subtask scores (#2867)  
Baber Abbasi committed
6
7
8
9 
aggregate_metric_list:
  - metric: acc_norm
    aggregation: mean
    weight_by_size: true