Commit e2529a6f authored by lintangsutawika's avatar lintangsutawika
Browse files

edit arc

parent 0456d543
......@@ -29,15 +29,17 @@ Homepage: https://allenai.org/data/arc
}
```
### Subtasks
### Groups and Tasks
#### Groups
* `ai2_arc`: Evaluates `arc_easy` and `arc_challenge`
#### Tasks
* `arc_easy`
* `arc_challange`
### Groups
* `ai2_arc`
* `multiple_choice`
### Checklist
For adding novel benchmarks/datasets to the library:
......
include: arc_easy.yaml
group:
- ai2_arc
- multiple_choice
task: arc_challenge
dataset_path: ai2_arc
dataset_name: ARC-Challenge
group:
- ai2_arc
- multiple_choice
task: arc_easy
dataset_path: ai2_arc
dataset_name: ARC-Easy
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment