Skip to content

GitLab

Commit c4c30c6a authored by lintangsutawika's avatar lintangsutawika
Browse files

edit headqa

parent 459a5347
Hide whitespace changes
Inline Side-by-side
Showing with 8 additions and 2 deletions
lm_eval/tasks/headqa/README.md
View file @ c4c30c6a
...@@ -32,7 +32,13 @@ Homepage: https://aghie.github.io/head-qa/ ...@@ -32,7 +32,13 @@ Homepage: https://aghie.github.io/head-qa/
} }
``` ```
### Subtasks ### Groups and Tasks
#### Groups
- `headqa`: Evaluates `headqa_en` and `headqa_es`
#### Tasks
* `headqa_en` - English variant of HEAD-QA * `headqa_en` - English variant of HEAD-QA
* `headqa_es` - Spanish variant of HEAD-QA * `headqa_es` - Spanish variant of HEAD-QA
......
lm_eval/tasks/headqa/headqa_en.yaml
View file @ c4c30c6a
group: group:
- multiple_choice - headqa
task: headqa_en task: headqa_en
dataset_path: EleutherAI/headqa dataset_path: EleutherAI/headqa
dataset_name: en dataset_name: en
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment