Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
d0d86b1c
Commit
d0d86b1c
authored
Aug 08, 2023
by
haileyschoelkopf
Browse files
add all crows pairs variants
parent
0247833d
Changes
21
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
80 additions
and
0 deletions
+80
-0
lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml
lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml
lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml
...val/tasks/crows_pairs/crows_pairs_english_disability.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml
lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml
...al/tasks/crows_pairs/crows_pairs_english_nationality.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml
.../crows_pairs/crows_pairs_english_physical_appearance.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml
...val/tasks/crows_pairs/crows_pairs_english_race_color.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml
lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml
...s/crows_pairs/crows_pairs_english_sexual_orientation.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml
.../tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml
lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml
lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml
lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml
lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml
...val/tasks/crows_pairs/crows_pairs_french_nationality.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml
...s/crows_pairs/crows_pairs_french_physical_appearance.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml
lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml
lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml
...ks/crows_pairs/crows_pairs_french_sexual_orientation.yaml
+4
-0
lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml
...l/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml
+4
-0
No files found.
lm_eval/tasks/crows_pairs/crows_pairs_english_age.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_english_age
dataset_name
:
english
process_docs
:
!function
utils.filter_age
lm_eval/tasks/crows_pairs/crows_pairs_english_autre.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_english_autre
dataset_name
:
english
process_docs
:
!function
utils.filter_autre
lm_eval/tasks/crows_pairs/crows_pairs_english_disability.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_english_disability
dataset_name
:
english
process_docs
:
!function
utils.filter_disability
lm_eval/tasks/crows_pairs/crows_pairs_english_gender.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_english_gender
dataset_name
:
english
process_docs
:
!function
utils.filter_gender
lm_eval/tasks/crows_pairs/crows_pairs_english_nationality.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_english_nationality
dataset_name
:
english
process_docs
:
!function
utils.filter_nationality
lm_eval/tasks/crows_pairs/crows_pairs_english_physical_appearance.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_english_physical_appearance
dataset_name
:
english
process_docs
:
!function
utils.filter_appearance
lm_eval/tasks/crows_pairs/crows_pairs_english_race_color.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_english_race_color
dataset_name
:
english
process_docs
:
!function
utils.filter_race_color
lm_eval/tasks/crows_pairs/crows_pairs_english_religion.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_english_religion
dataset_name
:
english
process_docs
:
!function
utils.filter_religion
lm_eval/tasks/crows_pairs/crows_pairs_english_sexual_orientation.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_english_sexual_orientation
dataset_name
:
english
process_docs
:
!function
utils.filter_orientation
lm_eval/tasks/crows_pairs/crows_pairs_english_socioeconomic.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_english_socioeconomic
dataset_name
:
english
process_docs
:
!function
utils.filter_socio
lm_eval/tasks/crows_pairs/crows_pairs_french_age.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_french_age
dataset_name
:
french
process_docs
:
!function
utils.filter_age
lm_eval/tasks/crows_pairs/crows_pairs_french_autre.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_french_autre
dataset_name
:
french
process_docs
:
!function
utils.filter_autre
lm_eval/tasks/crows_pairs/crows_pairs_french_disability.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_french_disability
dataset_name
:
french
process_docs
:
!function
utils.filter_disability
lm_eval/tasks/crows_pairs/crows_pairs_french_gender.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_french_gender
dataset_name
:
french
process_docs
:
!function
utils.filter_gender
lm_eval/tasks/crows_pairs/crows_pairs_french_nationality.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_french_nationality
dataset_name
:
french
process_docs
:
!function
utils.filter_nationality
lm_eval/tasks/crows_pairs/crows_pairs_french_physical_appearance.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_french_physical_appearance
dataset_name
:
french
process_docs
:
!function
utils.filter_appearance
lm_eval/tasks/crows_pairs/crows_pairs_french_race_color.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_french_race_color
dataset_name
:
french
process_docs
:
!function
utils.filter_race_color
lm_eval/tasks/crows_pairs/crows_pairs_french_religion.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_french_religion
dataset_name
:
french
process_docs
:
!function
utils.filter_religion
lm_eval/tasks/crows_pairs/crows_pairs_french_sexual_orientation.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_french_sexual_orientation
dataset_name
:
french
process_docs
:
!function
utils.filter_orientation
lm_eval/tasks/crows_pairs/crows_pairs_french_socioeconomic.yaml
0 → 100644
View file @
d0d86b1c
include
:
crows_pairs_english.yaml
task
:
crows_pairs_french_socioeconomic
dataset_name
:
french
process_docs
:
!function
utils.filter_socio
Prev
1
2
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment