Merge branch 'big-refactor' of...

Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into flan-benchmark

Merge branch 'big-refactor' of...
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into flan-benchmark
337492ad · lintangsutawika · 3d2ee4d4 · 4824a832 · 337492ad · 337492ad
Commit 337492ad authored Oct 05, 2023 by lintangsutawika
20 changed files
--- a/lm_eval/tasks/bigbench/greedy_until/operators.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/operators.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/paragraph_segmentation.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/paragraph_segmentation.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/parsinlu_qa.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/parsinlu_qa.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/parsinlu_reading_comprehension.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/parsinlu_reading_comprehension.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/penguins_in_a_table.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/penguins_in_a_table.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/periodic_elements.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/periodic_elements.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/persian_idioms.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/persian_idioms.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/phrase_relatedness.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/phrase_relatedness.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/physical_intuition.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/physical_intuition.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/physics.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/physics.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/physics_questions.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/physics_questions.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/play_dialog_same_or_different.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/play_dialog_same_or_different.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/polish_sequence_labeling.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/polish_sequence_labeling.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/presuppositions_as_nli.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/presuppositions_as_nli.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/qa_wikidata.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/qa_wikidata.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/question_selection.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/question_selection.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/real_or_fake_text.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/real_or_fake_text.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/reasoning_about_colored_objects.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/reasoning_about_colored_objects.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/repeat_copy_logic.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/repeat_copy_logic.yaml
--- a/lm_eval/tasks/bigbench/greedy_until/rephrase.yaml
+++ b/lm_eval/tasks/bigbench/greedy_until/rephrase.yaml