Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
95908d8b
Commit
95908d8b
authored
Dec 10, 2023
by
h-albert-lee
Browse files
Modify code for flake8
parent
9221cb57
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
lm_eval/tasks/kmmlu/utils.py
lm_eval/tasks/kmmlu/utils.py
+2
-2
No files found.
lm_eval/tasks/kmmlu/utils.py
View file @
95908d8b
import
datasets
def
process_docs
(
dataset
:
datasets
.
Dataset
)
->
datasets
.
Dataset
:
def
_process_doc
(
doc
):
instruction
=
(
...
...
@@ -12,9 +13,8 @@ def process_docs(dataset: datasets.Dataset) -> datasets.Dataset:
out_doc
=
{
"question"
:
instruction
,
"choices"
:
[
"(1)"
,
"(2)"
,
"(3)"
,
"(4)"
],
"gold"
:
int
(
doc
[
"gold"
])
-
1
,
"gold"
:
int
(
doc
[
"gold"
])
-
1
}
return
out_doc
return
dataset
.
map
(
_process_doc
)
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment