Skip to content

GitLab

Commit e414727a authored by lintangsutawika's avatar lintangsutawika
Browse files

edit crows_pairs

parent fe6a8658
Show whitespace changes
Inline Side-by-side
Showing with 7 additions and 3 deletions
lm_eval/tasks/crows_pairs/README.md
View file @ e414727a
...@@ -52,9 +52,15 @@ Homepage: https://github.com/nyu-mll/crows-pairs, https://gitlab.inria.fr/french ...@@ -52,9 +52,15 @@ Homepage: https://github.com/nyu-mll/crows-pairs, https://gitlab.inria.fr/french
} }
``` ```
### Subtasks ### Groups and Tasks
#### Groups
- `crows_pairs_english`: The entire English subset of the CrowS-Pairs dataset. - `crows_pairs_english`: The entire English subset of the CrowS-Pairs dataset.
- `crows_pairs_french`: The entire French subset of the CrowS-Pairs dataset.
#### Tasks
The following tasks evaluate sub-areas of bias in the English CrowS-Pairs dataset: The following tasks evaluate sub-areas of bias in the English CrowS-Pairs dataset:
- `crows_pairs_english_age` - `crows_pairs_english_age`
...@@ -68,8 +74,6 @@ The following tasks evaluate sub-areas of bias in the English CrowS-Pairs datase ...@@ -68,8 +74,6 @@ The following tasks evaluate sub-areas of bias in the English CrowS-Pairs datase
- `crows_pairs_english_sexual_orientation` - `crows_pairs_english_sexual_orientation`
- `crows_pairs_english_socioeconomic` - `crows_pairs_english_socioeconomic`
- `crows_pairs_french`: The entire French subset of the CrowS-Pairs dataset.
The following tasks evaluate sub-areas of bias in the French CrowS-Pairs dataset: The following tasks evaluate sub-areas of bias in the French CrowS-Pairs dataset:
- `crows_pairs_french_age` - `crows_pairs_french_age`
- `crows_pairs_french_autre` - `crows_pairs_french_autre`
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment