Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
utilitarianism.yaml 280 Bytes
Newer Older
lintangsutawika's avatar
updates, corrections, and fixes to match big-refactor  
lintangsutawika committed
1 
include: commonsense.yaml
haileyschoelkopf's avatar
add hendrycks ethics  
haileyschoelkopf committed
2
3
4
5
6
7 
group:
  - hendrycks_ethics
task: ethics_utilitarianism
dataset_name: utilitarianism
doc_to_text: !function utils.doc_to_text
doc_to_target: !function utils.doc_to_target
lintangsutawika's avatar
updates, corrections, and fixes to match big-refactor  
lintangsutawika committed
8 
doc_to_choice: ['no', 'yes']
haileyschoelkopf's avatar
add hendrycks ethics  
haileyschoelkopf committed
9
10 
metric_list:
  - metric: acc
lintangsutawika's avatar
add versions  
lintangsutawika committed
11 
metadata:
Hailey Schoelkopf's avatar
Correctly Print Task Versioning (#1173)  
Hailey Schoelkopf committed
12 
  version: 1.0