Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "43d85fbdac9f4dcae340c571bf8c86855cc8ceb5"
Unverified Commit b87ee153 authored by Lintang Sutawika's avatar Lintang Sutawika Committed by GitHub
Browse files

Update evaluator.py

parent e6d4ec39
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
lm_eval/evaluator.py
View file @ b87ee153
...@@ -625,7 +625,8 @@ def evaluate( ...@@ -625,7 +625,8 @@ def evaluate(
groups_agg[group]["alias"] = tab_string + group groups_agg[group]["alias"] = tab_string + group
for group_name, task_list in task_hierarchy.items(): for group_name, task_list in task_hierarchy.items():
num_fewshot[group_name] = num_fewshot[task_list[0]] if task_list != []:
num_fewshot[group_name] = num_fewshot[task_list[0]]
results_dict = { results_dict = {
"results": dict(results_agg.items()), "results": dict(results_agg.items()),
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment