Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
a78996bc
Unverified
Commit
a78996bc
authored
Oct 23, 2020
by
Stella Biderman
Committed by
GitHub
Oct 23, 2020
Browse files
Update README.md
parent
eb9a5224
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
25 deletions
+0
-25
README.md
README.md
+0
-25
No files found.
README.md
View file @
a78996bc
...
...
@@ -59,31 +59,6 @@ Both LMs (`lm_eval.models`) and Tasks (`lm_eval.tasks`) are kept in a registry d
**If you want to extend either models or tasks, simply add a new LM or Task subclass, and decorate with the registry decorator**
.
**GLUE**
-
[X] CoLA
-
[X] MNLI
-
[X] MRPC
-
[X] RTE
-
[X] QNLI
-
[X] QQP
-
[X] STS-B
-
[X] SST-2
-
[X] WNLI
**SuperGLUE**
-
[X] BoolQ
-
[X] CommitmentBank
-
[X] COPA
-
[ ] MultiRC
-
[ ] ReCoRD
-
[X] RTE (See: GLUE)
-
[X] WiC
-
[X] WSC
**QA Tasks**
-
[ ] CoQA
-
[ ] DROP
## Description
### 1. LM Evaluation
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment