Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
4eecbabb
Commit
4eecbabb
authored
Sep 16, 2024
by
Baber
Browse files
Merge branch 'main' into prefill
parents
dac8b534
fb963f0f
Changes
465
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
40 additions
and
60 deletions
+40
-60
lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml
...val/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml
.../tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml
...asks/tmmluplus/default/tmmluplus_introduction_to_law.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml
...val/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml
...l/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml
...asks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml
...l/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml
...asks/tmmluplus/default/tmmluplus_junior_science_exam.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml
...ks/tmmluplus/default/tmmluplus_junior_social_studies.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml
...val/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml
...al/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml
...val/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml
...ks/tmmluplus/default/tmmluplus_management_accounting.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml
...sks/tmmluplus/default/tmmluplus_marketing_management.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml
lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml
lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml
...asks/tmmluplus/default/tmmluplus_national_protection.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml
...l/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml
...lus_occupational_therapy_for_psychological_disorders.yaml
+2
-3
lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml
...uplus/default/tmmluplus_official_document_management.yaml
+2
-3
No files found.
lm_eval/tasks/tmmluplus/default/tmmluplus_human_behavior.yaml
View file @
4eecbabb
"
dataset_name"
:
"
human_behavior"
"
description"
:
"
以下為人類行為與社會的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_social_sciences"
"
group_alias"
:
"
social
sciences"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_social_sciences_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_human_behavior"
"
task_alias"
:
"
human
behavior"
lm_eval/tasks/tmmluplus/default/tmmluplus_insurance_studies.yaml
View file @
4eecbabb
"
dataset_name"
:
"
insurance_studies"
"
description"
:
"
以下為保險學的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_insurance_studies"
"
task_alias"
:
"
insurance
studies"
lm_eval/tasks/tmmluplus/default/tmmluplus_introduction_to_law.yaml
View file @
4eecbabb
"
dataset_name"
:
"
introduction_to_law"
"
description"
:
"
以下為法律概論的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_humanities"
"
group_alias"
:
"
humanities"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_humanities_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_introduction_to_law"
"
task_alias"
:
"
introduction
to
law"
lm_eval/tasks/tmmluplus/default/tmmluplus_jce_humanities.yaml
View file @
4eecbabb
"
dataset_name"
:
"
jce_humanities"
"
description"
:
"
以下為指考人文科目的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_humanities"
"
group_alias"
:
"
humanities"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_humanities_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_jce_humanities"
"
task_alias"
:
"
jce
humanities"
lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chemistry.yaml
View file @
4eecbabb
"
dataset_name"
:
"
junior_chemistry"
"
description"
:
"
以下為國中理化的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_STEM"
"
group_alias"
:
"
STEM"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_STEM_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_junior_chemistry"
"
task_alias"
:
"
junior
chemistry"
lm_eval/tasks/tmmluplus/default/tmmluplus_junior_chinese_exam.yaml
View file @
4eecbabb
"
dataset_name"
:
"
junior_chinese_exam"
"
description"
:
"
以下為國中會考基測國文的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_social_sciences"
"
group_alias"
:
"
social
sciences"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_social_sciences_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_junior_chinese_exam"
"
task_alias"
:
"
junior
chinese
exam"
lm_eval/tasks/tmmluplus/default/tmmluplus_junior_math_exam.yaml
View file @
4eecbabb
"
dataset_name"
:
"
junior_math_exam"
"
description"
:
"
以下為國中會考基測數學科的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_STEM"
"
group_alias"
:
"
STEM"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_STEM_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_junior_math_exam"
"
task_alias"
:
"
junior
math
exam"
lm_eval/tasks/tmmluplus/default/tmmluplus_junior_science_exam.yaml
View file @
4eecbabb
"
dataset_name"
:
"
junior_science_exam"
"
description"
:
"
以下為國中會考基測自然科的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_STEM"
"
group_alias"
:
"
STEM"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_STEM_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_junior_science_exam"
"
task_alias"
:
"
junior
science
exam"
lm_eval/tasks/tmmluplus/default/tmmluplus_junior_social_studies.yaml
View file @
4eecbabb
"
dataset_name"
:
"
junior_social_studies"
"
description"
:
"
以下為國中會考基測社會科的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_junior_social_studies"
"
task_alias"
:
"
junior
social
studies"
lm_eval/tasks/tmmluplus/default/tmmluplus_linear_algebra.yaml
View file @
4eecbabb
"
dataset_name"
:
"
linear_algebra"
"
description"
:
"
以下為線代的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_STEM"
"
group_alias"
:
"
STEM"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_STEM_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_linear_algebra"
"
task_alias"
:
"
linear
algebra"
lm_eval/tasks/tmmluplus/default/tmmluplus_logic_reasoning.yaml
View file @
4eecbabb
"
dataset_name"
:
"
logic_reasoning"
"
description"
:
"
以下為邏輯思維的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_logic_reasoning"
"
task_alias"
:
"
logic
reasoning"
lm_eval/tasks/tmmluplus/default/tmmluplus_macroeconomics.yaml
View file @
4eecbabb
"
dataset_name"
:
"
macroeconomics"
"
description"
:
"
以下為總經的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_social_sciences"
"
group_alias"
:
"
social
sciences"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_social_sciences_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_macroeconomics"
"
task_alias"
:
"
macroeconomics"
lm_eval/tasks/tmmluplus/default/tmmluplus_management_accounting.yaml
View file @
4eecbabb
"
dataset_name"
:
"
management_accounting"
"
description"
:
"
以下為管理會計的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_management_accounting"
"
task_alias"
:
"
management
accounting"
lm_eval/tasks/tmmluplus/default/tmmluplus_marketing_management.yaml
View file @
4eecbabb
"
dataset_name"
:
"
marketing_management"
"
description"
:
"
以下為行銷管理的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_marketing_management"
"
task_alias"
:
"
marketing
management"
lm_eval/tasks/tmmluplus/default/tmmluplus_mechanical.yaml
View file @
4eecbabb
"
dataset_name"
:
"
mechanical"
"
description"
:
"
以下為機械與機電概論的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_mechanical"
"
task_alias"
:
"
mechanical"
lm_eval/tasks/tmmluplus/default/tmmluplus_music.yaml
View file @
4eecbabb
"
dataset_name"
:
"
music"
"
description"
:
"
以下為音樂科的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_music"
"
task_alias"
:
"
music"
lm_eval/tasks/tmmluplus/default/tmmluplus_national_protection.yaml
View file @
4eecbabb
"
dataset_name"
:
"
national_protection"
"
description"
:
"
以下為軍事的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_social_sciences"
"
group_alias"
:
"
social
sciences"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_social_sciences_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_national_protection"
"
task_alias"
:
"
national
protection"
lm_eval/tasks/tmmluplus/default/tmmluplus_nautical_science.yaml
View file @
4eecbabb
"
dataset_name"
:
"
nautical_science"
"
description"
:
"
以下為航海的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_nautical_science"
"
task_alias"
:
"
nautical
science"
lm_eval/tasks/tmmluplus/default/tmmluplus_occupational_therapy_for_psychological_disorders.yaml
View file @
4eecbabb
"
dataset_name"
:
"
occupational_therapy_for_psychological_disorders"
"
description"
:
"
以下為心理障礙職能治療學的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_social_sciences"
"
group_alias"
:
"
social
sciences"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_social_sciences_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_occupational_therapy_for_psychological_disorders"
"
task_alias"
:
"
occupational
therapy
for
psychological
disorders"
lm_eval/tasks/tmmluplus/default/tmmluplus_official_document_management.yaml
View file @
4eecbabb
"
dataset_name"
:
"
official_document_management"
"
description"
:
"
以下為機關文書的單選題,請提供正確答案的選項。
\n\n
"
"
group"
:
"
tmmluplus_other"
"
group_alias"
:
"
other"
"
include"
:
"
_default_template_yaml"
"
tag"
:
"
tmmluplus_other_tasks"
"
include"
:
"
_tmmluplus_template_yaml"
"
task"
:
"
tmmluplus_official_document_management"
"
task_alias"
:
"
official
document
management"
Prev
1
…
18
19
20
21
22
23
24
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment