Skip to content

GitLab

Unverified Commit 71305a78 authored by Hailey Schoelkopf's avatar Hailey Schoelkopf Committed by GitHub
Browse files

Merge pull request #661 from fattorib/race-update-hf 

[Refactor] Move race dataset on HF to EleutherAI group
parents fdcdc494 31250b07
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
lm_eval/tasks/race/race.yaml
View file @ 71305a78
group: group:
- multiple_choice - multiple_choice
task: race task: race
dataset_path: bfattori/race dataset_path: EleutherAI/race
dataset_name: high dataset_name: high
output_type: multiple_choice output_type: multiple_choice
test_split: test test_split: test
...@@ -11,4 +11,4 @@ doc_to_target: !function preprocess_race.doc_to_target ...@@ -11,4 +11,4 @@ doc_to_target: !function preprocess_race.doc_to_target
metric_list: metric_list:
- metric: acc - metric: acc
aggregation: mean aggregation: mean
higher_is_better: true higher_is_better: true
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment