Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
hendrycks_math.yaml 366 Bytes
Newer Older
Hailey Schoelkopf's avatar
Re-add Hendrycks MATH (no sympy checking, no Minerva hardcoded prompt) variant (#1793)  
Hailey Schoelkopf committed
1
2
3
4
5
6
7
8
9 
group: hendrycks_math
task:
  - hendrycks_math_algebra
  - hendrycks_math_counting_and_prob
  - hendrycks_math_geometry
  - hendrycks_math_intermediate_algebra
  - hendrycks_math_num_theory
  - hendrycks_math_prealgebra
  - hendrycks_math_precalc
Lintang Sutawika's avatar
Group agg rework (#1741)  
Lintang Sutawika committed
10
11
12
13
14
15 
aggregate_metric_list:
  - metric: exact_match
    aggregation: mean
    weight_by_size: true
metadata:
  version: 1.0