Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
71d3655b
Commit
71d3655b
authored
Aug 17, 2023
by
Björn Bebensee
Browse files
Changed whitespace fix to match existing evaluation code
parent
9e5acd1d
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
lm_eval/tasks/nqopen.py
lm_eval/tasks/nqopen.py
+1
-1
No files found.
lm_eval/tasks/nqopen.py
View file @
71d3655b
...
...
@@ -98,7 +98,7 @@ class NQOpen(Task):
answers
=
[
answer
.
lower
().
translate
(
str
.
maketrans
(
''
,
''
,
string
.
punctuation
))
for
answer
in
doc
[
"answer"
]]
# remove duplicate whitespace
continuation
=
re
.
sub
(
' +'
,
' '
,
continuation
)
continuation
=
" "
.
join
(
continuation
.
split
()
)
# remove articles
continuation
=
re
.
sub
(
'(\s+)(a|an|the)(\s+)'
,
' '
,
continuation
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment