add val set task

060d78db · haileyschoelkopf · 3d732e68 · 060d78db
Commit 060d78db authored Aug 20, 2023 by haileyschoelkopf
Hide whitespace changes
Inline Side-by-side

Showing with 8 additions and 0 deletions

lm_eval/tasks/pile/pile_validation.yaml lm_eval/tasks/pile/pile_validation.yaml +8 -0

No files found.
--- a/lm_eval/tasks/pile/pile_validation.yaml
+++ b/lm_eval/tasks/pile/pile_validation.yaml
+include: pile_arxiv.yaml
+task: pile_validation
+dataset_kwargs:
+  streaming: true
+dataset_name: all
+training_split: null
+validation_split: null
+test_split: validation