Update pythia.yaml

a8390f78 · Lintang Sutawika · GitHub · a916afd7 · a8390f78
Unverified Commit a8390f78 authored Sep 11, 2023 by Lintang Sutawika Committed by GitHub Sep 11, 2023
Hide whitespace changes
Inline Side-by-side

Showing with 3 additions and 6 deletions

lm_eval/benchmarks/pythia.yaml lm_eval/benchmarks/pythia.yaml +3 -6

No files found.
--- a/lm_eval/benchmarks/pythia.yaml
+++ b/lm_eval/benchmarks/pythia.yaml
 group: pythia
 task:
  - lambada_openai
-  - wikitext
+  - logiqa
  - piqa
  - sciq
-  - wsc
+  - wikitext
  - winogrande
-  - arc
-  - logiqa
-  - blimp
-  - hendrycksTest*
+  - wsc