Skip to content

GitLab

"lm_eval/tasks/mmlu/generative/mmlu_human_sexuality.yaml" did not exist on "96336194817ae68391732e61c3caec058eec26b1"
Switch branch/tag
Find file Normal viewHistoryPermalink
mmlu_jurisprudence.yaml 242 Bytes
Newer Older
jonabur's avatar
add task for mmlu evaluation in arc multiple choice format (#1745)  
jonabur committed
1
2
3 
"dataset_name": "jurisprudence"
"description": "The following are questions (with answers) about jurisprudence.\n\
  \n"
Felix Michalak's avatar
Fix ```mmlu_continuation``` subgroup names to fit Readme and other variants (#3137)  
Felix Michalak committed
4 
"tag": "mmlu_humanities_continuation"
jonabur's avatar
add task for mmlu evaluation in arc multiple choice format (#1745)  
jonabur committed
5 
"include": "_continuation_template_yaml"
Felix Michalak's avatar
Fix ```mmlu_continuation``` subgroup names to fit Readme and other variants (#3137)  
Felix Michalak committed
6 
"task": "mmlu_jurisprudence_continuation"