Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
agieval_nous.yaml 320 Bytes
Newer Older
haileyschoelkopf's avatar
add groups for agieval, aexams, aclue  
haileyschoelkopf committed
1
2
3
4
5
6
7
8
9
10 
group: agieval_nous
task:
  - agieval_aqua_rat
  - agieval_logiqa_en
  - agieval_lsat_ar
  - agieval_lsat_lr
  - agieval_lsat_rc
  - agieval_sat_en_without_passage
  - agieval_sat_en
  - agieval_sat_math
haileyschoelkopf's avatar
add many explicit group configs  
haileyschoelkopf committed
11 
aggregate_metric_list:
haileyschoelkopf's avatar
add groups for agieval, aexams, aclue  
haileyschoelkopf committed
12
13
14
15
16 
  - metric: acc_norm
    aggregation: mean
    weight_by_size: true
metadata:
  version: 0.0