Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
0348ed97
Commit
0348ed97
authored
Oct 09, 2023
by
lintangsutawika
Browse files
merged latest update
parents
451a1873
6769119f
Changes
1000
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
80 additions
and
0 deletions
+80
-0
lm_eval/tasks/bigbench/greedy_until/strange_stories.yaml
lm_eval/tasks/bigbench/greedy_until/strange_stories.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/strategyqa.yaml
lm_eval/tasks/bigbench/greedy_until/strategyqa.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/sufficient_information.yaml
...l/tasks/bigbench/greedy_until/sufficient_information.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/suicide_risk.yaml
lm_eval/tasks/bigbench/greedy_until/suicide_risk.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/swahili_english_proverbs.yaml
...tasks/bigbench/greedy_until/swahili_english_proverbs.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/swedish_to_german_proverbs.yaml
...sks/bigbench/greedy_until/swedish_to_german_proverbs.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/symbol_interpretation.yaml
...al/tasks/bigbench/greedy_until/symbol_interpretation.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/temporal_sequences.yaml
lm_eval/tasks/bigbench/greedy_until/temporal_sequences.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/tense.yaml
lm_eval/tasks/bigbench/greedy_until/tense.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/timedial.yaml
lm_eval/tasks/bigbench/greedy_until/timedial.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/topical_chat.yaml
lm_eval/tasks/bigbench/greedy_until/topical_chat.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/tracking_shuffled_objects.yaml
...asks/bigbench/greedy_until/tracking_shuffled_objects.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/understanding_fables.yaml
...val/tasks/bigbench/greedy_until/understanding_fables.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/undo_permutation.yaml
lm_eval/tasks/bigbench/greedy_until/undo_permutation.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/unit_conversion.yaml
lm_eval/tasks/bigbench/greedy_until/unit_conversion.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/unit_interpretation.yaml
lm_eval/tasks/bigbench/greedy_until/unit_interpretation.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/unnatural_in_context_learning.yaml
.../bigbench/greedy_until/unnatural_in_context_learning.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/vitaminc_fact_verification.yaml
...sks/bigbench/greedy_until/vitaminc_fact_verification.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/what_is_the_tao.yaml
lm_eval/tasks/bigbench/greedy_until/what_is_the_tao.yaml
+4
-0
lm_eval/tasks/bigbench/greedy_until/which_wiki_edit.yaml
lm_eval/tasks/bigbench/greedy_until/which_wiki_edit.yaml
+4
-0
No files found.
Too many changes to show.
To preserve performance only
1000 of 1000+
files are displayed.
Plain diff
Email patch
lm_eval/tasks/bigbench/greedy_until/strange_stories.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
strange_stories_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_strange_stories_greedy_until
lm_eval/tasks/bigbench/greedy_until/strategyqa.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
strategyqa_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_strategyqa_greedy_until
lm_eval/tasks/bigbench/greedy_until/sufficient_information.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
sufficient_information_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_sufficient_information_greedy_until
lm_eval/tasks/bigbench/greedy_until/suicide_risk.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
suicide_risk_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_suicide_risk_greedy_until
lm_eval/tasks/bigbench/greedy_until/swahili_english_proverbs.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
swahili_english_proverbs_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_swahili_english_proverbs_greedy_until
lm_eval/tasks/bigbench/greedy_until/swedish_to_german_proverbs.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
swedish_to_german_proverbs_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_swedish_to_german_proverbs_greedy_until
lm_eval/tasks/bigbench/greedy_until/symbol_interpretation.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
symbol_interpretation_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_symbol_interpretation_greedy_until
lm_eval/tasks/bigbench/greedy_until/temporal_sequences.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
temporal_sequences_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_temporal_sequences_greedy_until
lm_eval/tasks/bigbench/greedy_until/tense.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
tense_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_tense_greedy_until
lm_eval/tasks/bigbench/greedy_until/timedial.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
timedial_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_timedial_greedy_until
lm_eval/tasks/bigbench/greedy_until/topical_chat.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
topical_chat_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_topical_chat_greedy_until
lm_eval/tasks/bigbench/greedy_until/tracking_shuffled_objects.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
tracking_shuffled_objects_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_tracking_shuffled_objects_greedy_until
lm_eval/tasks/bigbench/greedy_until/understanding_fables.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
understanding_fables_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_understanding_fables_greedy_until
lm_eval/tasks/bigbench/greedy_until/undo_permutation.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
undo_permutation_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_undo_permutation_greedy_until
lm_eval/tasks/bigbench/greedy_until/unit_conversion.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
unit_conversion_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_unit_conversion_greedy_until
lm_eval/tasks/bigbench/greedy_until/unit_interpretation.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
unit_interpretation_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_unit_interpretation_greedy_until
lm_eval/tasks/bigbench/greedy_until/unnatural_in_context_learning.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
unnatural_in_context_learning_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_unnatural_in_context_learning_greedy_until
lm_eval/tasks/bigbench/greedy_until/vitaminc_fact_verification.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
vitaminc_fact_verification_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_vitaminc_fact_verification_greedy_until
lm_eval/tasks/bigbench/greedy_until/what_is_the_tao.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
what_is_the_tao_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_what_is_the_tao_greedy_until
lm_eval/tasks/bigbench/greedy_until/which_wiki_edit.yaml
0 → 100644
View file @
0348ed97
# Generated by utils.py
dataset_name
:
which_wiki_edit_zero_shot
include
:
../greedy_until_template_yaml
task
:
bigbench_which_wiki_edit_greedy_until
Prev
1
…
13
14
15
16
17
18
19
20
21
…
50
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment