Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
56b2aa94
Commit
56b2aa94
authored
Apr 27, 2022
by
Zdenek Kasner
Browse files
e2e_nlg_cleaned: Remove custom aggregation() and higher_is_better() methods
parent
0033f1b6
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
22 deletions
+0
-22
lm_eval/tasks/e2e_nlg_cleaned.py
lm_eval/tasks/e2e_nlg_cleaned.py
+0
-22
No files found.
lm_eval/tasks/e2e_nlg_cleaned.py
View file @
56b2aa94
...
@@ -99,25 +99,3 @@ class E2E_NLG_Cleaned(PromptSourceTask):
...
@@ -99,25 +99,3 @@ class E2E_NLG_Cleaned(PromptSourceTask):
_requests
.
append
(
cont_request
)
_requests
.
append
(
cont_request
)
return
_requests
return
_requests
def
aggregation
(
self
):
"""
:returns: {str: [metric_score] -> float}
A dictionary where keys are the names of submetrics and values are
functions that aggregate a list of metric scores
"""
return
{
"bleu"
:
metrics
.
bleu
,
"rouge"
:
metrics
.
rouge
,
}
def
higher_is_better
(
self
):
"""
:returns: {str: bool}
A dictionary where keys are the names of submetrics and values are
whether a higher value of the submetric is better
"""
return
{
"bleu"
:
True
,
"rouge"
:
True
,
}
\ No newline at end of file
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment