Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
c239a8d8
Commit
c239a8d8
authored
Jul 10, 2025
by
Baber
Browse files
fixup
parent
66736bc1
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
lm_eval/config/task.py
lm_eval/config/task.py
+3
-3
No files found.
lm_eval/config/task.py
View file @
c239a8d8
...
...
@@ -215,7 +215,7 @@ class TaskConfig(dict):
fewshot_indices
=
_fewshot_cfg
.
get
(
"fewshot_indices"
,
None
),
)
def
get_metric
(
def
_
get_metric
(
self
,
metric_list
:
Optional
[
list
[
dict
]]
=
None
)
->
list
[
"MetricConfig"
]:
from
lm_eval.api.registry
import
(
...
...
@@ -325,7 +325,7 @@ class TaskConfig(dict):
FilterConfig
(
name
=
"none"
,
ensemble
=
build_filter_ensemble
(
"none"
,
[(
"take_first"
,
None
)]),
metric_list
=
self
.
get_metric
(
metric_list
=
None
),
metric_list
=
self
.
_
get_metric
(
metric_list
=
None
),
)
]
else
:
...
...
@@ -347,7 +347,7 @@ class TaskConfig(dict):
filter_name
=
cfg
[
"name"
],
components
=
[
_strip_fn
(
f
)
for
f
in
cfg
[
"filter"
]],
),
metric_list
=
self
.
get_metric
(
metric_list
=
cfg
.
get
(
"metric_list"
)),
metric_list
=
self
.
_
get_metric
(
metric_list
=
cfg
.
get
(
"metric_list"
)),
)
for
cfg
in
configs
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment