Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
_leaderboard_math.yaml 401 Bytes
Newer Older
Lintang Sutawika's avatar
Group agg rework (#1741)  
Lintang Sutawika committed
1
2
3
4
5
6
7
8
9 
group: leaderboard_math_hard
task:
  - leaderboard_math_algebra_hard
  - leaderboard_math_counting_and_prob_hard
  - leaderboard_math_geometry_hard
  - leaderboard_math_intermediate_algebra_hard
  - leaderboard_math_num_theory_hard
  - leaderboard_math_prealgebra_hard
  - leaderboard_math_precalculus_hard
Baber Abbasi's avatar
leaderboard - add subtask scores (#2867)  
Baber Abbasi committed
10
11
12
13 
aggregate_metric_list:
  - metric: exact_match
    aggregation: mean
    weight_by_size: true