Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
4be48911
Commit
4be48911
authored
Apr 28, 2022
by
Zdenek Kasner
Browse files
e2e_nlg_cleaned: Disable stopping criteria
parent
6588bc74
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
2 deletions
+5
-2
lm_eval/tasks/e2e_nlg_cleaned.py
lm_eval/tasks/e2e_nlg_cleaned.py
+5
-2
No files found.
lm_eval/tasks/e2e_nlg_cleaned.py
View file @
4be48911
...
...
@@ -58,8 +58,11 @@ class E2E_NLG_Cleaned(PromptSourceTask):
if
self
.
has_test_docs
():
return
self
.
dataset
[
"test"
]
def
stopping_criteria
(
self
):
return
'
\n\n
'
def
max_generation_length
(
self
):
return
64
# def stopping_criteria(self):
# return '\n\n'
def
invalid_doc_for_prompt
(
self
,
doc
)
->
bool
:
"""The QA prompts are not applicable to all the examples, we want to filter these out."""
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment