Skip to content

GitLab

"...lm_eval/tasks/belebele/belebele_hun_Latn.yaml" did not exist on "deb8370cf3b7ed7d3401bab887b214f130135594"
Switch branch/tag
Find file Normal viewHistoryPermalink
mmlu_jurisprudence.yaml 242 Bytes
Newer Older
jonabur's avatar
add task for mmlu evaluation in arc multiple choice format (#1745)  
jonabur committed
1
2
3 
"dataset_name": "jurisprudence"
"description": "The following are questions (with answers) about jurisprudence.\n\
  \n"
Lintang Sutawika's avatar
Group agg rework (#1741)  
Lintang Sutawika committed
4 
"tag": "mmlu_continuation_humanities"
jonabur's avatar
add task for mmlu evaluation in arc multiple choice format (#1745)  
jonabur committed
5
6 
"include": "_continuation_template_yaml"
"task": "mmlu_continuation_jurisprudence"