Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
67c0f73a
Commit
67c0f73a
authored
Oct 03, 2023
by
haileyschoelkopf
Browse files
add bigbench push_to_hub script
parent
fa608798
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
lm_eval/tasks/bigbench/push_bigbench_dataset.py
lm_eval/tasks/bigbench/push_bigbench_dataset.py
+1
-1
No files found.
lm_eval/tasks/bigbench/push_bigbench_dataset.py
View file @
67c0f73a
...
...
@@ -19,7 +19,7 @@ all_task_names = bb_utils.get_all_json_task_names()
num_shots
=
[
0
]
for
shots
in
num_shots
:
for
task_name
in
tqdm
(
all_task_names
[
29
:]
):
for
task_name
in
tqdm
(
all_task_names
):
try
:
print
(
f
"Loading '
{
task_name
}
' with num_shots=
{
shots
}
..."
)
task_ds
=
datasets
.
load_dataset
(
"bigbench"
,
name
=
task_name
,
num_shots
=
shots
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment