Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
0348ed97
Commit
0348ed97
authored
Oct 09, 2023
by
lintangsutawika
Browse files
merged latest update
parents
451a1873
6769119f
Changes
1000
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
80 additions
and
0 deletions
+80
-0
lm_eval/tasks/bigbench/greedy_until/odd_one_out.yaml
lm_eval/tasks/bigbench/greedy_until/odd_one_out.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/operators.yaml
lm_eval/tasks/bigbench/greedy_until/operators.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/paragraph_segmentation.yaml
...l/tasks/bigbench/greedy_until/paragraph_segmentation.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/parsinlu_qa.yaml
lm_eval/tasks/bigbench/greedy_until/parsinlu_qa.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/parsinlu_reading_comprehension.yaml
...bigbench/greedy_until/parsinlu_reading_comprehension.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/penguins_in_a_table.yaml
lm_eval/tasks/bigbench/greedy_until/penguins_in_a_table.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/periodic_elements.yaml
lm_eval/tasks/bigbench/greedy_until/periodic_elements.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/persian_idioms.yaml
lm_eval/tasks/bigbench/greedy_until/persian_idioms.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/phrase_relatedness.yaml
lm_eval/tasks/bigbench/greedy_until/phrase_relatedness.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/physical_intuition.yaml
lm_eval/tasks/bigbench/greedy_until/physical_intuition.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/physics.yaml
lm_eval/tasks/bigbench/greedy_until/physics.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/physics_questions.yaml
lm_eval/tasks/bigbench/greedy_until/physics_questions.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/play_dialog_same_or_different.yaml
.../bigbench/greedy_until/play_dialog_same_or_different.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/polish_sequence_labeling.yaml
...tasks/bigbench/greedy_until/polish_sequence_labeling.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/presuppositions_as_nli.yaml
...l/tasks/bigbench/greedy_until/presuppositions_as_nli.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/qa_wikidata.yaml
lm_eval/tasks/bigbench/greedy_until/qa_wikidata.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/question_selection.yaml
lm_eval/tasks/bigbench/greedy_until/question_selection.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/real_or_fake_text.yaml
lm_eval/tasks/bigbench/greedy_until/real_or_fake_text.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/reasoning_about_colored_objects.yaml
...igbench/greedy_until/reasoning_about_colored_objects.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/repeat_copy_logic.yaml
lm_eval/tasks/bigbench/greedy_until/repeat_copy_logic.yaml
+4
-0
No files found.
Too many changes to show.
To preserve performance only
1000 of 1000+
files are displayed.
Plain diff
Email patch
lm_eval/tasks/bigbench/greedy_until/odd_one_out.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
odd_one_out_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_odd_one_out_greedy_until
lm_eval/tasks/bigbench/greedy_until/operators.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
operators_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_operators_greedy_until
lm_eval/tasks/bigbench/greedy_until/paragraph_segmentation.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
paragraph_segmentation_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_paragraph_segmentation_greedy_until
lm_eval/tasks/bigbench/greedy_until/parsinlu_qa.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
parsinlu_qa_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_parsinlu_qa_greedy_until
lm_eval/tasks/bigbench/greedy_until/parsinlu_reading_comprehension.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
parsinlu_reading_comprehension_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_parsinlu_reading_comprehension_greedy_until
lm_eval/tasks/bigbench/greedy_until/penguins_in_a_table.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
penguins_in_a_table_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_penguins_in_a_table_greedy_until
lm_eval/tasks/bigbench/greedy_until/periodic_elements.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
periodic_elements_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_periodic_elements_greedy_until
lm_eval/tasks/bigbench/greedy_until/persian_idioms.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
persian_idioms_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_persian_idioms_greedy_until
lm_eval/tasks/bigbench/greedy_until/phrase_relatedness.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
phrase_relatedness_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_phrase_relatedness_greedy_until
lm_eval/tasks/bigbench/greedy_until/physical_intuition.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
physical_intuition_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_physical_intuition_greedy_until
lm_eval/tasks/bigbench/greedy_until/physics.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
physics_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_physics_greedy_until
lm_eval/tasks/bigbench/greedy_until/physics_questions.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
physics_questions_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_physics_questions_greedy_until
lm_eval/tasks/bigbench/greedy_until/play_dialog_same_or_different.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
play_dialog_same_or_different_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_play_dialog_same_or_different_greedy_until
lm_eval/tasks/bigbench/greedy_until/polish_sequence_labeling.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
polish_sequence_labeling_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_polish_sequence_labeling_greedy_until
lm_eval/tasks/bigbench/greedy_until/presuppositions_as_nli.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
presuppositions_as_nli_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_presuppositions_as_nli_greedy_until
lm_eval/tasks/bigbench/greedy_until/qa_wikidata.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
qa_wikidata_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_qa_wikidata_greedy_until
lm_eval/tasks/bigbench/greedy_until/question_selection.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
question_selection_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_question_selection_greedy_until
lm_eval/tasks/bigbench/greedy_until/real_or_fake_text.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
real_or_fake_text_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_real_or_fake_text_greedy_until
lm_eval/tasks/bigbench/greedy_until/reasoning_about_colored_objects.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
reasoning_about_colored_objects_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_reasoning_about_colored_objects_greedy_until
lm_eval/tasks/bigbench/greedy_until/repeat_copy_logic.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
repeat_copy_logic_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_repeat_copy_logic_greedy_until
Prev
1
…
11
12
13
14
15
16
17
18
19
…
50
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment