Skip to content

GitLab

Commit c3e3643d authored by lintangsutawika's avatar lintangsutawika
Browse files

n_shot value changed

parent 0bff23b4
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
lm_eval/evaluator.py
View file @ c3e3643d
...@@ -260,7 +260,7 @@ def evaluate( ...@@ -260,7 +260,7 @@ def evaluate(
if "num_fewshot" in configs[task_name]: if "num_fewshot" in configs[task_name]:
n_shot = configs[task_name]["num_fewshot"] n_shot = configs[task_name]["num_fewshot"]
else: else:
n_shot = -1 n_shot = 0
num_fewshot[task_name] = n_shot num_fewshot[task_name] = n_shot
if "task_alias" in configs[task_name]: if "task_alias" in configs[task_name]:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment