Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
4eecbabb
Commit
4eecbabb
authored
Sep 16, 2024
by
Baber
Browse files
Merge branch 'main' into prefill
parents
dac8b534
fb963f0f
Changes
465
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
40 additions
and
60 deletions
+40
-60
lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml
lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml
.../tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml
lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml
lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml
...tasks/tmmluplus/default/tmmluplus_physical_education.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml
lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml
...al/tasks/tmmluplus/default/tmmluplus_politic_science.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml
lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml
.../tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml
...us/default/tmmluplus_statistics_and_machine_learning.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml
.../tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml
lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml
lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml
...mluplus/default/tmmluplus_three_principles_of_people.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml
lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml
...uplus_traditional_chinese_medicine_clinical_medicine.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml
...val/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml
lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml
...sks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml
lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml
+2
-3
No files found.
lm_eval/tasks/tmmluplus/default/tmmluplus_optometry.yaml
View file @
4eecbabb
"
dataset_name"
:
"
optometry"
"
description"
:
"
以下為視光學的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_optometry"
"
task_alias"
:
"
optometry"
lm_eval/tasks/tmmluplus/default/tmmluplus_organic_chemistry.yaml
View file @
4eecbabb
"
dataset_name"
:
"
organic_chemistry"
"
description"
:
"
以下為有機化學的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_STEM"
"
group_alias"
:
"
STEM"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_STEM_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_organic_chemistry"
"
task_alias"
:
"
organic
chemistry"
lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacology.yaml
View file @
4eecbabb
"
dataset_name"
:
"
pharmacology"
"
description"
:
"
以下為藥理學的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_pharmacology"
"
task_alias"
:
"
pharmacology"
lm_eval/tasks/tmmluplus/default/tmmluplus_pharmacy.yaml
View file @
4eecbabb
"
dataset_name"
:
"
pharmacy"
"
description"
:
"
以下為藥劑學的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_STEM"
"
group_alias"
:
"
STEM"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_STEM_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_pharmacy"
"
task_alias"
:
"
pharmacy"
lm_eval/tasks/tmmluplus/default/tmmluplus_physical_education.yaml
View file @
4eecbabb
"
dataset_name"
:
"
physical_education"
"
description"
:
"
以下為體育的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_social_sciences"
"
group_alias"
:
"
social
sciences"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_social_sciences_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_physical_education"
"
task_alias"
:
"
physical
education"
lm_eval/tasks/tmmluplus/default/tmmluplus_physics.yaml
View file @
4eecbabb
"
dataset_name"
:
"
physics"
"
description"
:
"
以下為物理的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_STEM"
"
group_alias"
:
"
STEM"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_STEM_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_physics"
"
task_alias"
:
"
physics"
lm_eval/tasks/tmmluplus/default/tmmluplus_politic_science.yaml
View file @
4eecbabb
"
dataset_name"
:
"
politic_science"
"
description"
:
"
以下為政治的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_social_sciences"
"
group_alias"
:
"
social
sciences"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_social_sciences_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_politic_science"
"
task_alias"
:
"
politic
science"
lm_eval/tasks/tmmluplus/default/tmmluplus_real_estate.yaml
View file @
4eecbabb
"
dataset_name"
:
"
real_estate"
"
description"
:
"
以下為房地產的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_real_estate"
"
task_alias"
:
"
real
estate"
lm_eval/tasks/tmmluplus/default/tmmluplus_secondary_physics.yaml
View file @
4eecbabb
"
dataset_name"
:
"
secondary_physics"
"
description"
:
"
以下為高中物理的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_STEM"
"
group_alias"
:
"
STEM"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_STEM_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_secondary_physics"
"
task_alias"
:
"
secondary
physics"
lm_eval/tasks/tmmluplus/default/tmmluplus_statistics_and_machine_learning.yaml
View file @
4eecbabb
"
dataset_name"
:
"
statistics_and_machine_learning"
"
description"
:
"
以下為統計與機器學習的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_STEM"
"
group_alias"
:
"
STEM"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_STEM_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_statistics_and_machine_learning"
"
task_alias"
:
"
statistics
and
machine
learning"
lm_eval/tasks/tmmluplus/default/tmmluplus_taiwanese_hokkien.yaml
View file @
4eecbabb
"
dataset_name"
:
"
taiwanese_hokkien"
"
description"
:
"
以下為閩南語的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_social_sciences"
"
group_alias"
:
"
social
sciences"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_social_sciences_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_taiwanese_hokkien"
"
task_alias"
:
"
taiwanese
hokkien"
lm_eval/tasks/tmmluplus/default/tmmluplus_taxation.yaml
View file @
4eecbabb
"
dataset_name"
:
"
taxation"
"
description"
:
"
以下為稅務的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_humanities"
"
group_alias"
:
"
humanities"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_humanities_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_taxation"
"
task_alias"
:
"
taxation"
lm_eval/tasks/tmmluplus/default/tmmluplus_technical.yaml
View file @
4eecbabb
"
dataset_name"
:
"
technical"
"
description"
:
"
以下為技術工相關的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_technical"
"
task_alias"
:
"
technical"
lm_eval/tasks/tmmluplus/default/tmmluplus_three_principles_of_people.yaml
View file @
4eecbabb
"
dataset_name"
:
"
three_principles_of_people"
"
description"
:
"
以下為三民主義的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_social_sciences"
"
group_alias"
:
"
social
sciences"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_social_sciences_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_three_principles_of_people"
"
task_alias"
:
"
three
principles
of
people"
lm_eval/tasks/tmmluplus/default/tmmluplus_trade.yaml
View file @
4eecbabb
"
dataset_name"
:
"
trade"
"
description"
:
"
以下為貿易的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_trade"
"
task_alias"
:
"
trade"
lm_eval/tasks/tmmluplus/default/tmmluplus_traditional_chinese_medicine_clinical_medicine.yaml
View file @
4eecbabb
"
dataset_name"
:
"
traditional_chinese_medicine_clinical_medicine"
"
description"
:
"
以下為中醫臨床醫學的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_traditional_chinese_medicine_clinical_medicine"
"
task_alias"
:
"
traditional
chinese
medicine
clinical
medicine"
lm_eval/tasks/tmmluplus/default/tmmluplus_trust_practice.yaml
View file @
4eecbabb
"
dataset_name"
:
"
trust_practice"
"
description"
:
"
以下為信託實務的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_humanities"
"
group_alias"
:
"
humanities"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_humanities_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_trust_practice"
"
task_alias"
:
"
trust
practice"
lm_eval/tasks/tmmluplus/default/tmmluplus_ttqav2.yaml
View file @
4eecbabb
"
dataset_name"
:
"
ttqav2"
"
description"
:
"
以下為台灣在地用語的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_social_sciences"
"
group_alias"
:
"
social
sciences"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_social_sciences_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_ttqav2"
"
task_alias"
:
"
ttqav2"
lm_eval/tasks/tmmluplus/default/tmmluplus_tve_chinese_language.yaml
View file @
4eecbabb
"
dataset_name"
:
"
tve_chinese_language"
"
description"
:
"
以下為統測國文的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_social_sciences"
"
group_alias"
:
"
social
sciences"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_social_sciences_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_tve_chinese_language"
"
task_alias"
:
"
tve
chinese
language"
lm_eval/tasks/tmmluplus/default/tmmluplus_tve_design.yaml
View file @
4eecbabb
"
dataset_name"
:
"
tve_design"
"
description"
:
"
以下為統測
設計的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_tve_design"
"
task_alias"
:
"
tve
design"
Prev
1
…
19
20
21
22
23
24
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment