Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
b0040ba0
Unverified
Commit
b0040ba0
authored
Aug 21, 2025
by
James A. Michaelov
Committed by
GitHub
Aug 21, 2025
Browse files
Add BLiMP-NL (#3221)
* add blimp_nl * add template yaml file
parent
1bd96448
Changes
88
Hide whitespace changes
Inline
Side-by-side
Showing
8 changed files
with
24 additions
and
0 deletions
+24
-0
lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml
lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml
+3
-0
lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml
lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml
+3
-0
lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml
...sks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml
+3
-0
lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml
...sks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml
+3
-0
lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml
...al/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml
+3
-0
lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml
...al/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml
+3
-0
lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml
...mp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml
+3
-0
lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml
...tasks/blimp_nl/wh_movement_restrictions__superiority.yaml
+3
-0
No files found.
lm_eval/tasks/blimp_nl/wh_movement__stranding_1.yaml
0 → 100644
View file @
b0040ba0
dataset_name
:
wh_movement__stranding_1
include
:
_template_yaml
task
:
blimp_nl__wh_movement__stranding_1
lm_eval/tasks/blimp_nl/wh_movement__stranding_2.yaml
0 → 100644
View file @
b0040ba0
dataset_name
:
wh_movement__stranding_2
include
:
_template_yaml
task
:
blimp_nl__wh_movement__stranding_2
lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_1.yaml
0 → 100644
View file @
b0040ba0
dataset_name
:
wh_movement_restrictions__bridge_verb_1
include
:
_template_yaml
task
:
blimp_nl__wh_movement_restrictions__bridge_verb_1
lm_eval/tasks/blimp_nl/wh_movement_restrictions__bridge_verb_2.yaml
0 → 100644
View file @
b0040ba0
dataset_name
:
wh_movement_restrictions__bridge_verb_2
include
:
_template_yaml
task
:
blimp_nl__wh_movement_restrictions__bridge_verb_2
lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_1.yaml
0 → 100644
View file @
b0040ba0
dataset_name
:
wh_movement_restrictions__island_1
include
:
_template_yaml
task
:
blimp_nl__wh_movement_restrictions__island_1
lm_eval/tasks/blimp_nl/wh_movement_restrictions__island_2.yaml
0 → 100644
View file @
b0040ba0
dataset_name
:
wh_movement_restrictions__island_2
include
:
_template_yaml
task
:
blimp_nl__wh_movement_restrictions__island_2
lm_eval/tasks/blimp_nl/wh_movement_restrictions__resumptive_prolepsis.yaml
0 → 100644
View file @
b0040ba0
dataset_name
:
wh_movement_restrictions__resumptive_prolepsis
include
:
_template_yaml
task
:
blimp_nl__wh_movement_restrictions__resumptive_prolepsis
lm_eval/tasks/blimp_nl/wh_movement_restrictions__superiority.yaml
0 → 100644
View file @
b0040ba0
dataset_name
:
wh_movement_restrictions__superiority
include
:
_template_yaml
task
:
blimp_nl__wh_movement_restrictions__superiority
Prev
1
2
3
4
5
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment