Update evaluator.py

310250d3 · Lintang Sutawika · GitHub · 2820042d · 310250d3
Unverified Commit 310250d3 authored Jul 20, 2023 by Lintang Sutawika Committed by GitHub Jul 20, 2023
Hide whitespace changes
Inline Side-by-side

Showing with 0 additions and 1 deletion

lm_eval/evaluator.py lm_eval/evaluator.py +0 -1

No files found.
--- a/lm_eval/evaluator.py
+++ b/lm_eval/evaluator.py
@@ -225,7 +225,6 @@ def evaluate(
            "loglikelihood"
            if (
                task.OUTPUT_TYPE == "multiple_choice"
-                or task.OUTPUT_TYPE == "winograd_schema"
            )
            else task.OUTPUT_TYPE
        )  # TODO: this is hacky, fix in task.py