Skip to content

GitLab

Commit f2343efb authored by lintangsutawika's avatar lintangsutawika
Browse files

edit xwinograd

parent dfa8c5c0
Hide whitespace changes
Inline Side-by-side
Showing with 8 additions and 4 deletions
lm_eval/tasks/xwinograd/README.md
View file @ f2343efb
...@@ -31,7 +31,13 @@ Homepage: `https://huggingface.co/datasets/Muennighoff/xwinograd` ...@@ -31,7 +31,13 @@ Homepage: `https://huggingface.co/datasets/Muennighoff/xwinograd`
} }
``` ```
### Subtasks ### Groups and Tasks
#### Groups
* `xwinograd`
#### Tasks
List or describe tasks defined in this folder, and their names here: List or describe tasks defined in this folder, and their names here:
* `xwinograd_en`: Winograd schema challenges in English. * `xwinograd_en`: Winograd schema challenges in English.
......
lm_eval/tasks/xwinograd/xwinograd_common_yaml
View file @ f2343efb
...@@ -2,9 +2,7 @@ ...@@ -2,9 +2,7 @@
# It doesn't have a yaml file extension as it is not meant to be imported directly # It doesn't have a yaml file extension as it is not meant to be imported directly
# by the harness. # by the harness.
group: group:
- winograd - xwinograd
- commonsense
- multilingual
dataset_path: Muennighoff/xwinograd dataset_path: Muennighoff/xwinograd
dataset_name: null # Overridden by language-specific config. dataset_name: null # Overridden by language-specific config.
output_type: multiple_choice output_type: multiple_choice
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment