Skip to content

GitLab

"...fontawesome-free-5.12.0-desktop/svgs/brands/laravel.svg" did not exist on "204be94bfa2c6a9d9260125908cce162f4cf90f6"
Switch branch/tag
Find file Normal viewHistoryPermalink
mmlu_human_sexuality.yaml 254 Bytes
Newer Older
jonabur's avatar
add task for mmlu evaluation in arc multiple choice format (#1745)  
jonabur committed
1
2
3 
"dataset_name": "human_sexuality"
"description": "The following are questions (with answers) about human\
  \ sexuality.\n\n"
haileyschoelkopf's avatar
switch mmlu variants over to using  
haileyschoelkopf committed
4 
"tag": "mmlu_continuation_social_sciences"
jonabur's avatar
add task for mmlu evaluation in arc multiple choice format (#1745)  
jonabur committed
5
6 
"include": "_continuation_template_yaml"
"task": "mmlu_continuation_human_sexuality"