Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
9d4a04a0
Unverified
Commit
9d4a04a0
authored
Jul 18, 2024
by
Jungwhan Kim
Committed by
GitHub
Jul 18, 2024
Browse files
[python] fix haerae tasks (#2112)
parent
69502c06
Changes
6
Hide whitespace changes
Inline
Side-by-side
Showing
6 changed files
with
20 additions
and
20 deletions
+20
-20
lm_eval/tasks/haerae/_haerae.yaml
lm_eval/tasks/haerae/_haerae.yaml
+5
-5
lm_eval/tasks/haerae/haerae_gk.yaml
lm_eval/tasks/haerae/haerae_gk.yaml
+3
-3
lm_eval/tasks/haerae/haerae_hi.yaml
lm_eval/tasks/haerae/haerae_hi.yaml
+3
-3
lm_eval/tasks/haerae/haerae_lw.yaml
lm_eval/tasks/haerae/haerae_lw.yaml
+3
-3
lm_eval/tasks/haerae/haerae_rw.yaml
lm_eval/tasks/haerae/haerae_rw.yaml
+3
-3
lm_eval/tasks/haerae/haerae_sn.yaml
lm_eval/tasks/haerae/haerae_sn.yaml
+3
-3
No files found.
lm_eval/tasks/haerae/_haerae.yaml
View file @
9d4a04a0
group
:
haerae
task
:
-
haerae_g
k
-
haerae_hi
-
haerae_l
w
-
haerae_r
w
-
haerae_s
n
-
haerae_g
eneral_knowledge
-
haerae_hi
story
-
haerae_l
oan_word
-
haerae_r
are_word
-
haerae_s
tandard_nomenclature
aggregate_metric_list
:
-
metric
:
acc
aggregation
:
mean
...
...
lm_eval/tasks/haerae/haerae_gk.yaml
View file @
9d4a04a0
"
dataset_name
"
:
"
general_knowledge
"
"
include
"
:
"
_default_haerae_yaml
"
"
task
"
:
"
haerae_general_knowledge
"
dataset_name
:
general_knowledge
include
:
_default_haerae_yaml
task
:
haerae_general_knowledge
lm_eval/tasks/haerae/haerae_hi.yaml
View file @
9d4a04a0
"
dataset_name
"
:
"
history
"
"
include
"
:
"
_default_haerae_yaml
"
"
task
"
:
"
haerae_history
"
dataset_name
:
history
include
:
_default_haerae_yaml
task
:
haerae_history
lm_eval/tasks/haerae/haerae_lw.yaml
View file @
9d4a04a0
"
dataset_name
"
:
"
loan_words
"
"
include
"
:
"
_default_haerae_yaml
"
"
task
"
:
"
haerae_loan_word
"
dataset_name
:
loan_words
include
:
_default_haerae_yaml
task
:
haerae_loan_word
lm_eval/tasks/haerae/haerae_rw.yaml
View file @
9d4a04a0
"
dataset_name
"
:
"
rare_words
"
"
include
"
:
"
_default_haerae_yaml
"
"
task
"
:
"
haerae_rare_word
"
dataset_name
:
rare_words
include
:
_default_haerae_yaml
task
:
haerae_rare_word
lm_eval/tasks/haerae/haerae_sn.yaml
View file @
9d4a04a0
"
dataset_name
"
:
"
standard_nomenclature
"
"
include
"
:
"
_default_haerae_yaml
"
"
task
"
:
"
haerae_standard_nomenclature
"
dataset_name
:
standard_nomenclature
include
:
_default_haerae_yaml
task
:
haerae_standard_nomenclature
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment