Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
9799eb15
Unverified
Commit
9799eb15
authored
Jul 27, 2023
by
GUIJIN SON
Committed by
GitHub
Jul 27, 2023
Browse files
Update __init__.py
parent
7a1ec14f
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
7 additions
and
0 deletions
+7
-0
lm_eval/tasks/__init__.py
lm_eval/tasks/__init__.py
+7
-0
No files found.
lm_eval/tasks/__init__.py
View file @
9799eb15
...
...
@@ -64,6 +64,7 @@ from . import mgsm
from
.
import
scrolls
from
.
import
ceval
from
.
import
csatqa
from
.
import
haerae
########################################
# Translation tasks
...
...
@@ -325,6 +326,12 @@ TASK_REGISTRY = {
"csatqa_rcss"
:
csatqa
.
RCSS
,
"csatqa_rch"
:
csatqa
.
RCH
,
"csatqa_li"
:
csatqa
.
LI
,
"haerae_hi"
:
haerae
.
HI
,
"haerae_kgk"
:
haerae
.
KGK
,
"haerae_lw"
:
haerae
.
LW
,
"haerae_rc"
:
haerae
.
RC
,
"haerae_rw"
:
haerae
.
RW
,
"haerae_sn"
:
haerae
.
SN
,
# Requires manual download
# Requires manual download of data.
# "storycloze_2016": storycloze.StoryCloze2016,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment