Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
470059f6
Commit
470059f6
authored
Nov 24, 2023
by
lintangsutawika
Browse files
merge conflict
parents
b8d7d6c3
9d030712
Changes
1000
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
80 additions
and
0 deletions
+80
-0
lm_eval/tasks/bigbench/generate_until/irony_identification.yaml
...l/tasks/bigbench/generate_until/irony_identification.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml
lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/kannada.yaml
lm_eval/tasks/bigbench/generate_until/kannada.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml
lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml
lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/language_games.yaml
lm_eval/tasks/bigbench/generate_until/language_games.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/language_identification.yaml
...asks/bigbench/generate_until/language_identification.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml
...al/tasks/bigbench/generate_until/linguistic_mappings.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml
...al/tasks/bigbench/generate_until/linguistics_puzzles.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/list_functions.yaml
lm_eval/tasks/bigbench/generate_until/list_functions.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml
lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/logical_args.yaml
lm_eval/tasks/bigbench/generate_until/logical_args.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml
lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml
...ks/bigbench/generate_until/logical_fallacy_detection.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml
lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml
...tasks/bigbench/generate_until/mathematical_induction.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml
lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml
lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml
...tasks/bigbench/generate_until/metaphor_understanding.yaml
+4
-0
lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml
...al/tasks/bigbench/generate_until/minute_mysteries_qa.yaml
+4
-0
No files found.
Too many changes to show.
To preserve performance only
1000 of 1000+
files are displayed.
Plain diff
Email patch
lm_eval/tasks/bigbench/generate_until/irony_identification.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
irony_identification_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_irony_identification_generate_until
lm_eval/tasks/bigbench/generate_until/kanji_ascii.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
kanji_ascii_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_kanji_ascii_generate_until
lm_eval/tasks/bigbench/generate_until/kannada.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
kannada_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_kannada_generate_until
lm_eval/tasks/bigbench/generate_until/key_value_maps.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
key_value_maps_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_key_value_maps_generate_until
lm_eval/tasks/bigbench/generate_until/known_unknowns.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
known_unknowns_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_known_unknowns_generate_until
lm_eval/tasks/bigbench/generate_until/language_games.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
language_games_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_language_games_generate_until
lm_eval/tasks/bigbench/generate_until/language_identification.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
language_identification_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_language_identification_generate_until
lm_eval/tasks/bigbench/generate_until/linguistic_mappings.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
linguistic_mappings_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_linguistic_mappings_generate_until
lm_eval/tasks/bigbench/generate_until/linguistics_puzzles.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
linguistics_puzzles_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_linguistics_puzzles_generate_until
lm_eval/tasks/bigbench/generate_until/list_functions.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
list_functions_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_list_functions_generate_until
lm_eval/tasks/bigbench/generate_until/logic_grid_puzzle.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
logic_grid_puzzle_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_logic_grid_puzzle_generate_until
lm_eval/tasks/bigbench/generate_until/logical_args.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
logical_args_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_logical_args_generate_until
lm_eval/tasks/bigbench/generate_until/logical_deduction.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
logical_deduction_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_logical_deduction_generate_until
lm_eval/tasks/bigbench/generate_until/logical_fallacy_detection.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
logical_fallacy_detection_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_logical_fallacy_detection_generate_until
lm_eval/tasks/bigbench/generate_until/logical_sequence.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
logical_sequence_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_logical_sequence_generate_until
lm_eval/tasks/bigbench/generate_until/mathematical_induction.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
mathematical_induction_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_mathematical_induction_generate_until
lm_eval/tasks/bigbench/generate_until/matrixshapes.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
matrixshapes_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_matrixshapes_generate_until
lm_eval/tasks/bigbench/generate_until/metaphor_boolean.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
metaphor_boolean_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_metaphor_boolean_generate_until
lm_eval/tasks/bigbench/generate_until/metaphor_understanding.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
metaphor_understanding_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_metaphor_understanding_generate_until
lm_eval/tasks/bigbench/generate_until/minute_mysteries_qa.yaml
0 → 100644
View file @
470059f6
# Generated by utils.py
dataset_name
:
minute_mysteries_qa_zero_shot
include
:
../generate_until_template_yaml
task
:
bigbench_minute_mysteries_qa_generate_until
Prev
1
…
15
16
17
18
19
20
21
22
23
…
50
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment