Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
aa9e1062
Commit
aa9e1062
authored
Nov 17, 2023
by
haileyschoelkopf
Browse files
fix error when using wildcard task names
parent
f76941ef
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
1 deletion
+5
-1
lm_eval/__main__.py
lm_eval/__main__.py
+5
-1
No files found.
lm_eval/__main__.py
View file @
aa9e1062
...
...
@@ -149,7 +149,11 @@ def cli_evaluate(args: Union[argparse.Namespace, None] = None) -> None:
if
os
.
path
.
isfile
(
task
):
config
=
utils
.
load_yaml_config
(
task
)
task_names
.
append
(
config
)
task_missing
=
[
task
for
task
in
tasks_list
if
task
not
in
task_names
]
task_missing
=
[
task
for
task
in
tasks_list
if
task
not
in
task_names
and
"*"
not
in
task
]
if
task_missing
:
missing
=
", "
.
join
(
task_missing
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment