Add `acc_norm` metric to ZhoBLiMP (#3271)

ecebf1bd · James A. Michaelov · GitHub · aff14e50 · ecebf1bd
Unverified Commit ecebf1bd authored Sep 02, 2025 by James A. Michaelov Committed by GitHub Sep 02, 2025
Hide whitespace changes
Inline Side-by-side

Showing with 3 additions and 0 deletions

lm_eval/tasks/zhoblimp/_template_yaml lm_eval/tasks/zhoblimp/_template_yaml +3 -0

No files found.
--- a/lm_eval/tasks/zhoblimp/_template_yaml
+++ b/lm_eval/tasks/zhoblimp/_template_yaml
@@ -10,5 +10,8 @@ metric_list:
  - metric: acc
    aggregation: mean
    higher_is_better: true
+  - metric: acc_norm
+    aggregation: mean
+    higher_is_better: true
 metadata:
  version: 0