Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
6b4161c1
Unverified
Commit
6b4161c1
authored
Oct 19, 2023
by
Lintang Sutawika
Committed by
GitHub
Oct 19, 2023
Browse files
Changed `get_default_aggregation` to `get_aggregation`
parent
a6179b49
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
4 deletions
+1
-4
lm_eval/api/task.py
lm_eval/api/task.py
+1
-4
No files found.
lm_eval/api/task.py
View file @
6b4161c1
...
...
@@ -33,7 +33,6 @@ from lm_eval.api.metrics import (
from
lm_eval.api.registry
import
(
get_metric
,
get_aggregation
,
get_default_aggregation
,
is_higher_better
,
DEFAULT_METRIC_REGISTRY
,
OUTPUT_TYPE_REGISTRY
,
...
...
@@ -543,9 +542,7 @@ class ConfigurableTask(Task):
# TODO: handle this in TaskConfig.__post_init__ ?
for
metric_name
in
_metric_list
:
self
.
_metric_fn_list
[
metric_name
]
=
get_metric
(
metric_name
)
self
.
_aggregation_list
[
metric_name
]
=
get_default_aggregation
(
metric_name
)
self
.
_aggregation_list
[
metric_name
]
=
get_aggregation
(
metric_name
)
self
.
_higher_is_better
[
metric_name
]
=
is_higher_better
(
metric_name
)
else
:
for
metric_config
in
self
.
config
.
metric_list
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment