Commit 41a8b582 authored by Jon Tow's avatar Jon Tow
Browse files

Undo formatting

parent e4d852a0
...@@ -93,7 +93,7 @@ class DROP(Task): ...@@ -93,7 +93,7 @@ class DROP(Task):
dict where keys are the names of submetrics and values are the values of dict where keys are the names of submetrics and values are the values of
the metric for that one document the metric for that one document
:param :param doc:
The document as returned from training_docs, validation_docs, or test_docs. The document as returned from training_docs, validation_docs, or test_docs.
:param results: :param results:
The results of the requests created in construct_requests. The results of the requests created in construct_requests.
...@@ -161,9 +161,8 @@ class DROP(Task): ...@@ -161,9 +161,8 @@ class DROP(Task):
def aggregation(self): def aggregation(self):
""" """
:returns: {str: [float] -> float} :returns: {str: [float] -> float}
A dictionary where keys are the names of submetrics and values are A dictionary where keys are the names of submetrics and values are
A dictionary where keys are the names of submetrics and values are functions that aggregate a list of metrics
functions that aggregate a list of metrics
""" """
return { return {
"em": mean, "em": mean,
...@@ -173,9 +172,8 @@ class DROP(Task): ...@@ -173,9 +172,8 @@ class DROP(Task):
def higher_is_better(self): def higher_is_better(self):
""" """
:returns: {str: bool} :returns: {str: bool}
A dictionary where keys are the names of submetrics and values are A dictionary where keys are the names of submetrics and values are
A dictionary where keys are the names of submetrics and values are whether a higher value of the submetric is better
whether a higher value of the submetric is better
""" """
return { return {
"em": True, "em": True,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment