Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
1b14602e
"web/extensions/vscode:/vscode.git/clone" did not exist on "e45d920ae392c608b9cfcb1f863cfc8688ebb518"
Commit
1b14602e
authored
Dec 08, 2023
by
h-albert-lee
Browse files
implementing kmmlu
parent
e5dfd030
Changes
48
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
60 additions
and
0 deletions
+60
-0
lm_eval/tasks/kmmlu/kmmlu_food processing.yaml
lm_eval/tasks/kmmlu/kmmlu_food processing.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_gas technology and engineering.yaml
...val/tasks/kmmlu/kmmlu_gas technology and engineering.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_general physics.yaml
lm_eval/tasks/kmmlu/kmmlu_general physics.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_geomatics.yaml
lm_eval/tasks/kmmlu/kmmlu_geomatics.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_health.yaml
lm_eval/tasks/kmmlu/kmmlu_health.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_industrial engineer.yaml
lm_eval/tasks/kmmlu/kmmlu_industrial engineer.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_information technology.yaml
lm_eval/tasks/kmmlu/kmmlu_information technology.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_interior architecture and design.yaml
...l/tasks/kmmlu/kmmlu_interior architecture and design.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_korean language.yaml
lm_eval/tasks/kmmlu/kmmlu_korean language.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_law.yaml
lm_eval/tasks/kmmlu/kmmlu_law.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_machine design and manufacturing.yaml
...l/tasks/kmmlu/kmmlu_machine design and manufacturing.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_management.yaml
lm_eval/tasks/kmmlu/kmmlu_management.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_maritime engineering.yaml
lm_eval/tasks/kmmlu/kmmlu_maritime engineering.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_marketing.yaml
lm_eval/tasks/kmmlu/kmmlu_marketing.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_materials engineering.yaml
lm_eval/tasks/kmmlu/kmmlu_materials engineering.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_mechanical engineering.yaml
lm_eval/tasks/kmmlu/kmmlu_mechanical engineering.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_nondestructive testing.yaml
lm_eval/tasks/kmmlu/kmmlu_nondestructive testing.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_patent.yaml
lm_eval/tasks/kmmlu/kmmlu_patent.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_political science and sociology.yaml
...al/tasks/kmmlu/kmmlu_political science and sociology.yaml
+3
-0
lm_eval/tasks/kmmlu/kmmlu_psychology.yaml
lm_eval/tasks/kmmlu/kmmlu_psychology.yaml
+3
-0
No files found.
lm_eval/tasks/kmmlu/kmmlu_food processing.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Food Processing
include
:
_default_kmmlu_yaml
task
:
kmmlu_food processing
lm_eval/tasks/kmmlu/kmmlu_gas technology and engineering.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Gas Technology and Engineering
include
:
_default_kmmlu_yaml
task
:
kmmlu_gas technology and engineering
lm_eval/tasks/kmmlu/kmmlu_general physics.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
General Physics
include
:
_default_kmmlu_yaml
task
:
kmmlu_general physics
lm_eval/tasks/kmmlu/kmmlu_geomatics.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Geomatics
include
:
_default_kmmlu_yaml
task
:
kmmlu_geomatics
lm_eval/tasks/kmmlu/kmmlu_health.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Health
include
:
_default_kmmlu_yaml
task
:
kmmlu_health
lm_eval/tasks/kmmlu/kmmlu_industrial engineer.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Industrial Engineer
include
:
_default_kmmlu_yaml
task
:
kmmlu_industrial engineer
lm_eval/tasks/kmmlu/kmmlu_information technology.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Information Technology
include
:
_default_kmmlu_yaml
task
:
kmmlu_information technology
lm_eval/tasks/kmmlu/kmmlu_interior architecture and design.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Interior Architecture and Design
include
:
_default_kmmlu_yaml
task
:
kmmlu_interior architecture and design
lm_eval/tasks/kmmlu/kmmlu_korean language.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Korean Language
include
:
_default_kmmlu_yaml
task
:
kmmlu_korean language
lm_eval/tasks/kmmlu/kmmlu_law.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Law
include
:
_default_kmmlu_yaml
task
:
kmmlu_law
lm_eval/tasks/kmmlu/kmmlu_machine design and manufacturing.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Machine Design and Manufacturing
include
:
_default_kmmlu_yaml
task
:
kmmlu_machine design and manufacturing
\ No newline at end of file
lm_eval/tasks/kmmlu/kmmlu_management.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Management
include
:
_default_kmmlu_yaml
task
:
kmmlu_management
lm_eval/tasks/kmmlu/kmmlu_maritime engineering.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Maritime Engineering
include
:
_default_kmmlu_yaml
task
:
kmmlu_maritime engineering
lm_eval/tasks/kmmlu/kmmlu_marketing.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Marketing
include
:
_default_kmmlu_yaml
task
:
kmmlu_marketing
lm_eval/tasks/kmmlu/kmmlu_materials engineering.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Materials Engineering
include
:
_default_kmmlu_yaml
task
:
kmmlu_materials engineering
lm_eval/tasks/kmmlu/kmmlu_mechanical engineering.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Mechanical Engineering
include
:
_default_kmmlu_yaml
task
:
kmmlu_mechanical engineering
lm_eval/tasks/kmmlu/kmmlu_nondestructive testing.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Nondestructive Testing
include
:
_default_kmmlu_yaml
task
:
kmmlu_nondestructive testing
lm_eval/tasks/kmmlu/kmmlu_patent.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Patent
include
:
_default_kmmlu_yaml
task
:
kmmlu_patent
lm_eval/tasks/kmmlu/kmmlu_political science and sociology.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Political Science and Sociology
include
:
_default_kmmlu_yaml
task
:
kmmlu_political science and sociology
lm_eval/tasks/kmmlu/kmmlu_psychology.yaml
0 → 100644
View file @
1b14602e
dataset_name
:
Psychology
include
:
_default_kmmlu_yaml
task
:
kmmlu_psychology
Prev
1
2
3
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment