Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
2d5d94da
Commit
2d5d94da
authored
Sep 15, 2023
by
haileyschoelkopf
Browse files
add ceval
parent
b29ef521
Changes
55
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
80 additions
and
0 deletions
+80
-0
lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml
...ceval-valid_environmental_impact_assessment_engineer.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml
lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml
lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml
lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml
lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml
lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml
lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml
lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml
lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml
lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml
.../ceval/ceval-valid_ideological_and_moral_cultivation.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_law.yaml
lm_eval/tasks/ceval/ceval-valid_law.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml
lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_logic.yaml
lm_eval/tasks/ceval/ceval-valid_logic.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml
lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_marxism.yaml
lm_eval/tasks/ceval/ceval-valid_marxism.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml
lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml
lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml
lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml
+4
-0
lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml
lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml
+4
-0
No files found.
lm_eval/tasks/ceval/ceval-valid_environmental_impact_assessment_engineer.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
environmental_impact_assessment_engineer"
"
description"
:
"
以下是中国关于环境影响评价工程师的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_environmental_impact_assessment_engineer"
lm_eval/tasks/ceval/ceval-valid_fire_engineer.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
fire_engineer"
"
description"
:
"
以下是中国关于注册消防工程师的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_fire_engineer"
lm_eval/tasks/ceval/ceval-valid_high_school_biology.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
high_school_biology"
"
description"
:
"
以下是中国关于高中生物的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_high_school_biology"
lm_eval/tasks/ceval/ceval-valid_high_school_chemistry.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
high_school_chemistry"
"
description"
:
"
以下是中国关于高中化学的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_high_school_chemistry"
lm_eval/tasks/ceval/ceval-valid_high_school_chinese.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
high_school_chinese"
"
description"
:
"
以下是中国关于高中语文的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_high_school_chinese"
lm_eval/tasks/ceval/ceval-valid_high_school_geography.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
high_school_geography"
"
description"
:
"
以下是中国关于高中地理的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_high_school_geography"
lm_eval/tasks/ceval/ceval-valid_high_school_history.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
high_school_history"
"
description"
:
"
以下是中国关于高中历史的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_high_school_history"
lm_eval/tasks/ceval/ceval-valid_high_school_mathematics.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
high_school_mathematics"
"
description"
:
"
以下是中国关于高中数学的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_high_school_mathematics"
lm_eval/tasks/ceval/ceval-valid_high_school_physics.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
high_school_physics"
"
description"
:
"
以下是中国关于高中物理的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_high_school_physics"
lm_eval/tasks/ceval/ceval-valid_high_school_politics.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
high_school_politics"
"
description"
:
"
以下是中国关于高中政治的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_high_school_politics"
lm_eval/tasks/ceval/ceval-valid_ideological_and_moral_cultivation.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
ideological_and_moral_cultivation"
"
description"
:
"
以下是中国关于思想道德修养与法律基础的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_ideological_and_moral_cultivation"
lm_eval/tasks/ceval/ceval-valid_law.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
law"
"
description"
:
"
以下是中国关于法学的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_law"
lm_eval/tasks/ceval/ceval-valid_legal_professional.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
legal_professional"
"
description"
:
"
以下是中国关于法律职业资格的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_legal_professional"
lm_eval/tasks/ceval/ceval-valid_logic.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
logic"
"
description"
:
"
以下是中国关于逻辑学的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_logic"
lm_eval/tasks/ceval/ceval-valid_mao_zedong_thought.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
mao_zedong_thought"
"
description"
:
"
以下是中国关于毛泽东思想和中国特色社会主义理论体系概论的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_mao_zedong_thought"
lm_eval/tasks/ceval/ceval-valid_marxism.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
marxism"
"
description"
:
"
以下是中国关于马克思主义基本原理的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_marxism"
lm_eval/tasks/ceval/ceval-valid_metrology_engineer.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
metrology_engineer"
"
description"
:
"
以下是中国关于注册计量师的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_metrology_engineer"
lm_eval/tasks/ceval/ceval-valid_middle_school_biology.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
middle_school_biology"
"
description"
:
"
以下是中国关于初中生物的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_middle_school_biology"
lm_eval/tasks/ceval/ceval-valid_middle_school_chemistry.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
middle_school_chemistry"
"
description"
:
"
以下是中国关于初中化学的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_middle_school_chemistry"
lm_eval/tasks/ceval/ceval-valid_middle_school_geography.yaml
0 → 100644
View file @
2d5d94da
"
dataset_name"
:
"
middle_school_geography"
"
description"
:
"
以下是中国关于初中地理的单项选择题,请选出其中的正确答案。
\n\n
"
"
include"
:
"
_default_ceval_yaml"
"
task"
:
"
ceval-valid_middle_school_geography"
Prev
1
2
3
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment