Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
2d5d94da
Commit
2d5d94da
authored
Sep 15, 2023
by
haileyschoelkopf
Browse files
add ceval
parent
b29ef521
Changes
55
Show whitespace changes
Inline
Side-by-side
Showing
15 changed files
with
60 additions
and
0 deletions
+60
-0
lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml
lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml
...al/tasks/ceval/ceval-valid_middle_school_mathematics.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml
lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml
lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml
lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_operating_system.yaml
lm_eval/tasks/ceval/ceval-valid_operating_system.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_physician.yaml
lm_eval/tasks/ceval/ceval-valid_physician.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml
lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml
...l/tasks/ceval/ceval-valid_probability_and_statistics.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml
lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_sports_science.yaml
lm_eval/tasks/ceval/ceval-valid_sports_science.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml
lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml
lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml
lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml
lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml
+4
-0
No files found.
lm_eval/tasks/ceval/ceval-valid_middle_school_history.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
middle_school_history"
"
description"
:
"
以下是中国关于初中历史的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_middle_school_history"
lm_eval/tasks/ceval/ceval-valid_middle_school_mathematics.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
middle_school_mathematics"
"
description"
:
"
以下是中国关于初中数学的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_middle_school_mathematics"
lm_eval/tasks/ceval/ceval-valid_middle_school_physics.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
middle_school_physics"
"
description"
:
"
以下是中国关于初中物理的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_middle_school_physics"
lm_eval/tasks/ceval/ceval-valid_middle_school_politics.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
middle_school_politics"
"
description"
:
"
以下是中国关于初中政治的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_middle_school_politics"
lm_eval/tasks/ceval/ceval-valid_modern_chinese_history.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
modern_chinese_history"
"
description"
:
"
以下是中国关于近代史纲要的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_modern_chinese_history"
lm_eval/tasks/ceval/ceval-valid_operating_system.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
operating_system"
"
description"
:
"
以下是中国关于操作系统的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_operating_system"
lm_eval/tasks/ceval/ceval-valid_physician.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
physician"
"
description"
:
"
以下是中国关于医师资格的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_physician"
lm_eval/tasks/ceval/ceval-valid_plant_protection.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
plant_protection"
"
description"
:
"
以下是中国关于植物保护的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_plant_protection"
lm_eval/tasks/ceval/ceval-valid_probability_and_statistics.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
probability_and_statistics"
"
description"
:
"
以下是中国关于概率统计的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_probability_and_statistics"
lm_eval/tasks/ceval/ceval-valid_professional_tour_guide.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
professional_tour_guide"
"
description"
:
"
以下是中国关于导游资格的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_professional_tour_guide"
lm_eval/tasks/ceval/ceval-valid_sports_science.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
sports_science"
"
description"
:
"
以下是中国关于体育学的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_sports_science"
lm_eval/tasks/ceval/ceval-valid_tax_accountant.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
tax_accountant"
"
description"
:
"
以下是中国关于税务师的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_tax_accountant"
lm_eval/tasks/ceval/ceval-valid_teacher_qualification.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
teacher_qualification"
"
description"
:
"
以下是中国关于教师资格的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_teacher_qualification"
lm_eval/tasks/ceval/ceval-valid_urban_and_rural_planner.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
urban_and_rural_planner"
"
description"
:
"
以下是中国关于注册城乡规划师的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_urban_and_rural_planner"
lm_eval/tasks/ceval/ceval-valid_veterinary_medicine.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
veterinary_medicine"
"
description"
:
"
以下是中国关于兽医学的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_veterinary_medicine"
Prev
1
2
3
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment