Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
3e1301bb
Commit
3e1301bb
authored
Jun 04, 2024
by
lintangsutawika
Browse files
resolved merge conflict from latest version
parents
fd9cd80f
070d31df
Changes
539
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
16 additions
and
32 deletions
+16
-32
lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml
...val/tasks/bigbench/multiple_choice/entailed_polarity.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml
...sks/bigbench/multiple_choice/entailed_polarity_hindi.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml
...l/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml
.../multiple_choice/evaluating_information_essentiality.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml
lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml
...val/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/few_shot_nlg.yaml
lm_eval/tasks/bigbench/multiple_choice/few_shot_nlg.yaml
+0
-4
lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml
.../bigbench/multiple_choice/figure_of_speech_detection.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml
...multiple_choice/formal_fallacies_syllogisms_negation.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/gem.yaml
lm_eval/tasks/bigbench/multiple_choice/gem.yaml
+0
-4
lm_eval/tasks/bigbench/multiple_choice/gender_inclusive_sentences_german.yaml
...ch/multiple_choice/gender_inclusive_sentences_german.yaml
+0
-4
lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml
...val/tasks/bigbench/multiple_choice/general_knowledge.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml
lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml
...val/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml
...s/bigbench/multiple_choice/gre_reading_comprehension.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml
lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/hindi_question_answering.yaml
...ks/bigbench/multiple_choice/hindi_question_answering.yaml
+0
-4
lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml
lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml
...val/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml
+1
-1
lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml
...l/tasks/bigbench/multiple_choice/human_organs_senses.yaml
+1
-1
No files found.
lm_eval/tasks/bigbench/multiple_choice/entailed_polarity.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
entailed_polarity_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_entailed_polarity_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/entailed_polarity_hindi.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
entailed_polarity_hindi_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_entailed_polarity_hindi_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/epistemic_reasoning.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
epistemic_reasoning_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_epistemic_reasoning_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/evaluating_information_essentiality.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
evaluating_information_essentiality_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_evaluating_information_essentiality_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/fact_checker.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
fact_checker_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_fact_checker_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/fantasy_reasoning.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
fantasy_reasoning_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_fantasy_reasoning_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/few_shot_nlg.yaml
deleted
100644 → 0
View file @
fd9cd80f
# Generated by utils.py
dataset_name
:
few_shot_nlg_zero_shot
include
:
../multiple_choice_template_yaml
task
:
bigbench_few_shot_nlg_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/figure_of_speech_detection.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
figure_of_speech_detection_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_figure_of_speech_detection_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/formal_fallacies_syllogisms_negation.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
formal_fallacies_syllogisms_negation_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_formal_fallacies_syllogisms_negation_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/gem.yaml
deleted
100644 → 0
View file @
fd9cd80f
# Generated by utils.py
dataset_name
:
gem_zero_shot
include
:
../multiple_choice_template_yaml
task
:
bigbench_gem_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/gender_inclusive_sentences_german.yaml
deleted
100644 → 0
View file @
fd9cd80f
# Generated by utils.py
dataset_name
:
gender_inclusive_sentences_german_zero_shot
include
:
../multiple_choice_template_yaml
task
:
bigbench_gender_inclusive_sentences_german_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/general_knowledge.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
general_knowledge_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_general_knowledge_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/geometric_shapes.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
geometric_shapes_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_geometric_shapes_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/goal_step_wikihow.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
goal_step_wikihow_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_goal_step_wikihow_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/gre_reading_comprehension.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
gre_reading_comprehension_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_gre_reading_comprehension_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/hhh_alignment.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
hhh_alignment_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_hhh_alignment_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/hindi_question_answering.yaml
deleted
100644 → 0
View file @
fd9cd80f
# Generated by utils.py
dataset_name
:
hindi_question_answering_zero_shot
include
:
../multiple_choice_template_yaml
task
:
bigbench_hindi_question_answering_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/hindu_knowledge.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
hindu_knowledge_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_hindu_knowledge_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/hinglish_toxicity.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
hinglish_toxicity_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_hinglish_toxicity_multiple_choice
lm_eval/tasks/bigbench/multiple_choice/human_organs_senses.yaml
View file @
3e1301bb
# Generated by utils.py
dataset_name
:
human_organs_senses_zero_shot
include
:
../multiple_choice_template_yaml
include
:
../multiple_choice_template_
a_
yaml
task
:
bigbench_human_organs_senses_multiple_choice
Prev
1
…
3
4
5
6
7
8
9
10
11
…
27
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment