Update polemo2_in.yaml (#1318)

4477d572 · Lintang Sutawika · GitHub · b93c3bcb · 4477d572
Unverified Commit 4477d572 authored Jan 20, 2024 by Lintang Sutawika Committed by GitHub Jan 19, 2024
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

lm_eval/tasks/polemo2/polemo2_in.yaml lm_eval/tasks/polemo2/polemo2_in.yaml +1 -0

No files found.
--- a/lm_eval/tasks/polemo2/polemo2_in.yaml
+++ b/lm_eval/tasks/polemo2/polemo2_in.yaml
@@ -41,5 +41,6 @@ metric_list:
  - metric: accuracy
    aggregation: mean
    higher_is_better: true
+    hf_evaluate: true
 metadata:
  version: 1.0