Merge pull request #661 from fattorib/race-update-hf

[Refactor] Move race dataset on HF to EleutherAI group

Merge pull request #661 from fattorib/race-update-hf
[Refactor] Move race dataset on HF to EleutherAI group
71305a78 · Hailey Schoelkopf · GitHub · fdcdc494 · 31250b07 · 71305a78
Unverified Commit 71305a78 authored Jul 06, 2023 by Hailey Schoelkopf Committed by GitHub Jul 06, 2023
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 2 deletions

lm_eval/tasks/race/race.yaml lm_eval/tasks/race/race.yaml +2 -2

No files found.
--- a/lm_eval/tasks/race/race.yaml
+++ b/lm_eval/tasks/race/race.yaml
 group:
  - multiple_choice
 task: race
-dataset_path: bfattori/race
+dataset_path: EleutherAI/race
 dataset_name: high
 output_type: multiple_choice
 test_split: test
@@ -11,4 +11,4 @@ doc_to_target: !function preprocess_race.doc_to_target
 metric_list:
  - metric: acc
    aggregation: mean
-    higher_is_better: true
\ No newline at end of file
+    higher_is_better: true