Skip to content

GitLab

"git@developer.sourcefind.cn:gaoqiong/migraphx.git" did not exist on "04e3585e089d1b6651551e564c0a0f7ad1e6d7c2"
Commit cd441ab1 authored by Yu Shi Jie's avatar Yu Shi Jie
Browse files

mmlu-pro: update yaml content in line with mmlu

parent 5bae76d6
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 4 deletions
lm_eval/tasks/mmlu_pro/generative/mmlu_pro_biology.yaml
View file @ cd441ab1
"dataset_name": "biology" "dataset_name": "biology"
"description": "The following are multiple choice questions (with answers) about biology.\n\ "description": "The following are multiple choice questions (with answers) about biology.\n\
\n" \n"
"group": "mmlu_pro_stem_generative" "tag": "mmlu_pro_stem_generative"
"group_alias": "stem"
"include": "_default_template_yaml" "include": "_default_template_yaml"
"task": "mmlu_pro_biology_generative" "task": "mmlu_pro_biology_generative"
"task_alias": "biology" "task_alias": "biology"
lm_eval/tasks/mmlu_pro/generative/mmlu_pro_psychology.yaml
View file @ cd441ab1
"dataset_name": "psychology" "dataset_name": "psychology"
"description": "The following are multiple choice questions (with answers) about psychology.\n\ "description": "The following are multiple choice questions (with answers) about psychology.\n\
\n" \n"
"group": "mmlu_pro_social_sciences_generative" "tag": "mmlu_pro_social_sciences_generative"
"group_alias": "social_sciences"
"include": "_default_template_yaml" "include": "_default_template_yaml"
"task": "mmlu_pro_psychology_generative" "task": "mmlu_pro_psychology_generative"
"task_alias": "psychology" "task_alias": "psychology"
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment