n_shot value changed

c3e3643d · lintangsutawika · 0bff23b4 · c3e3643d
Commit c3e3643d authored Nov 29, 2023 by lintangsutawika
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

lm_eval/evaluator.py lm_eval/evaluator.py +1 -1

No files found.
--- a/lm_eval/evaluator.py
+++ b/lm_eval/evaluator.py
@@ -260,7 +260,7 @@ def evaluate(
        if "num_fewshot" in configs[task_name]:
            n_shot = configs[task_name]["num_fewshot"]
        else:
-            n_shot = -1
+            n_shot = 0
        num_fewshot[task_name] = n_shot

        if "task_alias" in configs[task_name]: