Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
e04aab6d
Commit
e04aab6d
authored
Apr 28, 2022
by
Jan-Christoph Kalo
Browse files
added task to init
parent
27a8f231
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
0 deletions
+8
-0
lm_eval/tasks/__init__.py
lm_eval/tasks/__init__.py
+8
-0
No files found.
lm_eval/tasks/__init__.py
View file @
e04aab6d
...
...
@@ -5,6 +5,9 @@ from typing import List, Union
import
sacrebleu
import
lm_eval.base
from
.
import
bigsciencelama
from
.
import
lama
from
.
import
superglue
from
.
import
glue
from
.
import
arc
...
...
@@ -308,6 +311,11 @@ TASK_REGISTRY = {
"gem_xsum_challenge_test_bfp_05"
:
gem_xsum
.
GEMXSUMChallgeTestBFP05
,
"gem_xsum_challenge_test_nopunc"
:
gem_xsum
.
GEMXSUMChallgeTestNopunc
,
"gem_xsum_challenge_test_covid"
:
gem_xsum
.
GEMXSUMChallgeTestCovid
,
#LAMA
"lama-trex"
:
lama
.
Trex
,
"bigscience-lama"
:
bigsciencelama
.
BigScienceLAMA
,
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment