Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
835cc40e
"...lm-evaluation-harness.git" did not exist on "b1746639a459176b86514b92b1e9a03eaf4fd103"
Commit
835cc40e
authored
Dec 06, 2023
by
lintangsutawika
Browse files
merged latest and added altworld files
parents
8da401e0
c9bbec6e
Changes
430
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
lm_eval/tasks/blimp/npi_present_2.yaml
lm_eval/tasks/blimp/npi_present_2.yaml
+1
-1
lm_eval/tasks/blimp/only_npi_licensor_present.yaml
lm_eval/tasks/blimp/only_npi_licensor_present.yaml
+1
-1
lm_eval/tasks/blimp/only_npi_scope.yaml
lm_eval/tasks/blimp/only_npi_scope.yaml
+1
-1
lm_eval/tasks/blimp/passive_1.yaml
lm_eval/tasks/blimp/passive_1.yaml
+1
-1
lm_eval/tasks/blimp/passive_2.yaml
lm_eval/tasks/blimp/passive_2.yaml
+1
-1
lm_eval/tasks/blimp/principle_A_c_command.yaml
lm_eval/tasks/blimp/principle_A_c_command.yaml
+1
-1
lm_eval/tasks/blimp/principle_A_case_1.yaml
lm_eval/tasks/blimp/principle_A_case_1.yaml
+1
-1
lm_eval/tasks/blimp/principle_A_case_2.yaml
lm_eval/tasks/blimp/principle_A_case_2.yaml
+1
-1
lm_eval/tasks/blimp/principle_A_domain_1.yaml
lm_eval/tasks/blimp/principle_A_domain_1.yaml
+1
-1
lm_eval/tasks/blimp/principle_A_domain_2.yaml
lm_eval/tasks/blimp/principle_A_domain_2.yaml
+1
-1
lm_eval/tasks/blimp/principle_A_domain_3.yaml
lm_eval/tasks/blimp/principle_A_domain_3.yaml
+1
-1
lm_eval/tasks/blimp/principle_A_reconstruction.yaml
lm_eval/tasks/blimp/principle_A_reconstruction.yaml
+1
-1
lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml
.../tasks/blimp/regular_plural_subject_verb_agreement_1.yaml
+1
-1
lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml
.../tasks/blimp/regular_plural_subject_verb_agreement_2.yaml
+1
-1
lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml
...tasks/blimp/sentential_negation_npi_licensor_present.yaml
+1
-1
lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml
lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml
+1
-1
lm_eval/tasks/blimp/sentential_subject_island.yaml
lm_eval/tasks/blimp/sentential_subject_island.yaml
+1
-1
lm_eval/tasks/blimp/superlative_quantifiers_1.yaml
lm_eval/tasks/blimp/superlative_quantifiers_1.yaml
+1
-1
lm_eval/tasks/blimp/superlative_quantifiers_2.yaml
lm_eval/tasks/blimp/superlative_quantifiers_2.yaml
+1
-1
lm_eval/tasks/blimp/tough_vs_raising_1.yaml
lm_eval/tasks/blimp/tough_vs_raising_1.yaml
+1
-1
No files found.
lm_eval/tasks/blimp/npi_present_2.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
npi_present_2
dataset_name
:
npi_present_2
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_npi_present_2
task
:
blimp_npi_present_2
lm_eval/tasks/blimp/only_npi_licensor_present.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
only_npi_licensor_present
dataset_name
:
only_npi_licensor_present
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_only_npi_licensor_present
task
:
blimp_only_npi_licensor_present
lm_eval/tasks/blimp/only_npi_scope.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
only_npi_scope
dataset_name
:
only_npi_scope
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_only_npi_scope
task
:
blimp_only_npi_scope
lm_eval/tasks/blimp/passive_1.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
passive_1
dataset_name
:
passive_1
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_passive_1
task
:
blimp_passive_1
lm_eval/tasks/blimp/passive_2.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
passive_2
dataset_name
:
passive_2
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_passive_2
task
:
blimp_passive_2
lm_eval/tasks/blimp/principle_A_c_command.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
principle_A_c_command
dataset_name
:
principle_A_c_command
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_principle_A_c_command
task
:
blimp_principle_A_c_command
lm_eval/tasks/blimp/principle_A_case_1.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
principle_A_case_1
dataset_name
:
principle_A_case_1
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_principle_A_case_1
task
:
blimp_principle_A_case_1
lm_eval/tasks/blimp/principle_A_case_2.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
principle_A_case_2
dataset_name
:
principle_A_case_2
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_principle_A_case_2
task
:
blimp_principle_A_case_2
lm_eval/tasks/blimp/principle_A_domain_1.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
principle_A_domain_1
dataset_name
:
principle_A_domain_1
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_principle_A_domain_1
task
:
blimp_principle_A_domain_1
lm_eval/tasks/blimp/principle_A_domain_2.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
principle_A_domain_2
dataset_name
:
principle_A_domain_2
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_principle_A_domain_2
task
:
blimp_principle_A_domain_2
lm_eval/tasks/blimp/principle_A_domain_3.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
principle_A_domain_3
dataset_name
:
principle_A_domain_3
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_principle_A_domain_3
task
:
blimp_principle_A_domain_3
lm_eval/tasks/blimp/principle_A_reconstruction.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
principle_A_reconstruction
dataset_name
:
principle_A_reconstruction
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_principle_A_reconstruction
task
:
blimp_principle_A_reconstruction
lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_1.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
regular_plural_subject_verb_agreement_1
dataset_name
:
regular_plural_subject_verb_agreement_1
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_regular_plural_subject_verb_agreement_1
task
:
blimp_regular_plural_subject_verb_agreement_1
lm_eval/tasks/blimp/regular_plural_subject_verb_agreement_2.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
regular_plural_subject_verb_agreement_2
dataset_name
:
regular_plural_subject_verb_agreement_2
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_regular_plural_subject_verb_agreement_2
task
:
blimp_regular_plural_subject_verb_agreement_2
lm_eval/tasks/blimp/sentential_negation_npi_licensor_present.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
sentential_negation_npi_licensor_present
dataset_name
:
sentential_negation_npi_licensor_present
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_sentential_negation_npi_licensor_present
task
:
blimp_sentential_negation_npi_licensor_present
lm_eval/tasks/blimp/sentential_negation_npi_scope.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
sentential_negation_npi_scope
dataset_name
:
sentential_negation_npi_scope
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_sentential_negation_npi_scope
task
:
blimp_sentential_negation_npi_scope
lm_eval/tasks/blimp/sentential_subject_island.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
sentential_subject_island
dataset_name
:
sentential_subject_island
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_sentential_subject_island
task
:
blimp_sentential_subject_island
lm_eval/tasks/blimp/superlative_quantifiers_1.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
superlative_quantifiers_1
dataset_name
:
superlative_quantifiers_1
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_superlative_quantifiers_1
task
:
blimp_superlative_quantifiers_1
lm_eval/tasks/blimp/superlative_quantifiers_2.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
superlative_quantifiers_2
dataset_name
:
superlative_quantifiers_2
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_superlative_quantifiers_2
task
:
blimp_superlative_quantifiers_2
lm_eval/tasks/blimp/tough_vs_raising_1.yaml
View file @
835cc40e
# Generated by utils.py
# Generated by utils.py
dataset_name
:
tough_vs_raising_1
dataset_name
:
tough_vs_raising_1
include
:
template_yaml
include
:
_
template_yaml
task
:
blimp_tough_vs_raising_1
task
:
blimp_tough_vs_raising_1
Prev
1
…
8
9
10
11
12
13
14
15
16
…
22
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment