Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
a92d47eb
Unverified
Commit
a92d47eb
authored
Jun 19, 2021
by
sdtblck
Committed by
GitHub
Jun 19, 2021
Browse files
Update __init__.py
parent
4cd4b05c
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
7 additions
and
0 deletions
+7
-0
lm_eval/tasks/__init__.py
lm_eval/tasks/__init__.py
+7
-0
No files found.
lm_eval/tasks/__init__.py
View file @
a92d47eb
...
...
@@ -40,6 +40,7 @@ from . import cbt
from
.
import
lambada_cloze
from
.
import
pile
from
.
import
wikitext
from
.
import
lambada_multilingual
########################################
# Translation tasks
...
...
@@ -97,6 +98,11 @@ TASK_REGISTRY = {
"drop"
:
drop
.
DROP
,
"lambada"
:
lambada
.
LAMBADA
,
"lambada_cloze"
:
lambada_cloze
.
LAMBADA_cloze
,
# multlingual lambada
**
multilingual_lambada
.
construct_tasks
(),
lambada_multilingual
"wikitext"
:
wikitext
.
WikiText
,
# "cbt-cn": cbt.CBTCN, # disabled pending context length fix
# "cbt-ne": cbt.CBTNE, # disabled pending context length fix
...
...
@@ -200,6 +206,7 @@ TASK_REGISTRY = {
"pile_ubuntu-irc"
:
pile
.
PileUbuntuIrc
,
"pile_wikipedia"
:
pile
.
PileWikipedia
,
"pile_youtubesubtitles"
:
pile
.
PileYoutubeSubtitles
,
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment