Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
f76941ef
Unverified
Commit
f76941ef
authored
Nov 17, 2023
by
Lintang Sutawika
Committed by
GitHub
Nov 17, 2023
Browse files
Merge pull request #1001 from EleutherAI/fix-alias
[Refactor] will check if group_name is None
parents
056569e5
bf6cf1de
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
2 deletions
+5
-2
lm_eval/evaluator.py
lm_eval/evaluator.py
+5
-2
No files found.
lm_eval/evaluator.py
View file @
f76941ef
...
...
@@ -226,6 +226,7 @@ def evaluate(
versions
[
group_name
]
=
"N/A"
else
:
group_name
=
None
task_hierarchy
[
task_name
]
=
[]
if
task
is
None
:
...
...
@@ -237,8 +238,10 @@ def evaluate(
if
"task_alias"
in
configs
[
task_name
]:
task_group_alias
[
task_name
]
=
configs
[
task_name
][
"task_alias"
]
if
(
"group_alias"
in
configs
[
task_name
])
and
(
group_name
not
in
task_group_alias
if
(
(
"group_alias"
in
configs
[
task_name
])
and
(
group_name
not
in
task_group_alias
)
and
(
group_name
is
not
None
)
):
task_group_alias
[
group_name
]
=
configs
[
task_name
][
"group_alias"
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment