Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
b7f896c7
Commit
b7f896c7
authored
May 18, 2023
by
lintangsutawika
Browse files
fixed so that fewshot from argparse is passed to the task
parent
1c0a1f8e
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
lm_eval/tasks/__init__.py
lm_eval/tasks/__init__.py
+3
-3
No files found.
lm_eval/tasks/__init__.py
View file @
b7f896c7
...
...
@@ -43,8 +43,8 @@ for root, subdirs, file_list in os.walk(task_dir):
if
'group'
in
config
:
for
group
in
config
[
'group'
]:
register_group
(
group
)(
SubClass
)
except
:
p
ass
except
Exception
as
err
:
p
rint
(
f
"Unexpected
{
err
=
}
,
{
type
(
err
)
=
}
"
)
TASK_REGISTRY
=
task_registry
GROUP_REGISTRY
=
group_registry
...
...
@@ -52,7 +52,7 @@ ALL_TASKS = sorted(list(TASK_REGISTRY.keys()) + list(GROUP_REGISTRY.keys()))
def
get_task
(
task_name
,
config
):
try
:
return
TASK_REGISTRY
[
task_name
](
config
)
return
TASK_REGISTRY
[
task_name
](
config
=
config
)
except
KeyError
:
eval_logger
.
info
(
"Available tasks:"
)
eval_logger
.
info
(
TASK_REGISTRY
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment