Commit 51a43a76 authored by haileyschoelkopf's avatar haileyschoelkopf
Browse files

change back to original dataset path

parent 54498fcc
...@@ -2,9 +2,9 @@ ...@@ -2,9 +2,9 @@
A utility script that pushes all Bigbench subtasks from their form in the `bigbench` HF dataset A utility script that pushes all Bigbench subtasks from their form in the `bigbench` HF dataset
into `{org name}/bigbench`. into `{org name}/bigbench`.
Prior to running, must log into HF Hub for the target HF hub org via `huggingface-cli login`. Prior to running, log into HF Hub for the target HF hub org via `huggingface-cli login`.
Requires the installation of Requires the installation of
`pip install "bigbench @ https://storage.googleapis.com/public_research_data/bigbench/bigbench-0.0.1.tar.gz"` `pip install "bigbench @ https://storage.googleapis.com/public_research_data/bigbench/bigbench-0.0.1.tar.gz"`
and is included so that the bigbench dependency can be avoided. and is included so that the bigbench dependency can be avoided.
""" """
...@@ -20,7 +20,7 @@ num_shots = [0] ...@@ -20,7 +20,7 @@ num_shots = [0]
for shots in num_shots: for shots in num_shots:
for task_name in tqdm(all_task_names): for task_name in tqdm(all_task_names):
try: try:
print(f"Loading '{task_name}' with num_shots={shots}...") print(f"Loading '{task_name}' with num_shots={shots}...")
task_ds = datasets.load_dataset("bigbench", name=task_name, num_shots=shots) task_ds = datasets.load_dataset("bigbench", name=task_name, num_shots=shots)
...@@ -29,4 +29,4 @@ for shots in num_shots: ...@@ -29,4 +29,4 @@ for shots in num_shots:
del task_ds del task_ds
except Exception as e: except Exception as e:
raise e raise e
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment