Skip to content

GitLab

Unverified Commit 39c2bb4e authored by Lintang Sutawika's avatar Lintang Sutawika Committed by GitHub
Browse files

Merge pull request #1033 from EleutherAI/lintangsutawika-patch-4 

[Refactor] Urgent fix
parents e6d4ec39 b87ee153
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
lm_eval/evaluator.py
View file @ 39c2bb4e
...@@ -625,7 +625,8 @@ def evaluate( ...@@ -625,7 +625,8 @@ def evaluate(
groups_agg[group]["alias"] = tab_string + group groups_agg[group]["alias"] = tab_string + group
for group_name, task_list in task_hierarchy.items(): for group_name, task_list in task_hierarchy.items():
num_fewshot[group_name] = num_fewshot[task_list[0]] if task_list != []:
num_fewshot[group_name] = num_fewshot[task_list[0]]
results_dict = { results_dict = {
"results": dict(results_agg.items()), "results": dict(results_agg.items()),
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment