Add ZhoBLiMP benchmark (#3218)

* add zhoblimp files * correct group name * fix group * add normalized accuracy

Add ZhoBLiMP benchmark (#3218)
* add zhoblimp files * correct group name * fix group * add normalized accuracy
1bd96448 · James A. Michaelov · GitHub · 51d8a192 · 1bd96448 · 1bd96448
Unverified Commit 1bd96448 authored Aug 21, 2025 by James A. Michaelov Committed by GitHub Aug 21, 2025
Showing with 131 additions and 0 deletions

lm_eval/tasks/zhoblimp/you_yige.yaml lm_eval/tasks/zhoblimp/you_yige.yaml +3 -0

lm_eval/tasks/zhoblimp/zhoblimp_group.yaml lm_eval/tasks/zhoblimp/zhoblimp_group.yaml +128 -0

No files found.
--- a/lm_eval/tasks/zhoblimp/you_yige.yaml
+++ b/lm_eval/tasks/zhoblimp/you_yige.yaml
--- a/lm_eval/tasks/zhoblimp/zhoblimp_group.yaml
+++ b/lm_eval/tasks/zhoblimp/zhoblimp_group.yaml