Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
f7aeeff2
Commit
f7aeeff2
authored
Dec 12, 2022
by
jon-tow
Browse files
Bump `triviaqa` version
parent
0742f4d7
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
3 additions
and
1 deletion
+3
-1
lm_eval/tasks/triviaqa.py
lm_eval/tasks/triviaqa.py
+1
-1
tests/testdata/triviaqa-v1-loglikelihood
tests/testdata/triviaqa-v1-loglikelihood
+1
-0
tests/testdata/triviaqa-v1-res.json
tests/testdata/triviaqa-v1-res.json
+1
-0
No files found.
lm_eval/tasks/triviaqa.py
View file @
f7aeeff2
...
@@ -29,7 +29,7 @@ _CITATION = """
...
@@ -29,7 +29,7 @@ _CITATION = """
class
TriviaQA
(
Task
):
class
TriviaQA
(
Task
):
VERSION
=
0
VERSION
=
1
DATASET_PATH
=
inspect
.
getfile
(
lm_eval
.
datasets
.
triviaqa
.
triviaqa
)
DATASET_PATH
=
inspect
.
getfile
(
lm_eval
.
datasets
.
triviaqa
.
triviaqa
)
DATASET_NAME
=
None
DATASET_NAME
=
None
...
...
tests/testdata/triviaqa-v1-loglikelihood
0 → 100644
View file @
f7aeeff2
f8ec05b306b9f6187c0f8117cae441fb85a7a2e4670f4f9a1a3b632b1978421a
\ No newline at end of file
tests/testdata/triviaqa-v1-res.json
0 → 100644
View file @
f7aeeff2
{
"results"
:
{
"triviaqa"
:
{
"acc"
:
0.0
,
"acc_stderr"
:
0.0
}},
"versions"
:
{
"triviaqa"
:
1
}}
\ No newline at end of file
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment