Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
c0d5a660
Commit
c0d5a660
authored
Jan 17, 2024
by
lintangsutawika
Browse files
resolved conflict
parents
f7b81bd4
0d1ef037
Changes
1000
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
120 additions
and
0 deletions
+120
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_01/b.yaml
...ernative_worlds/arc_easy/output_variation/style_01/b.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_01/c.yaml
...ernative_worlds/arc_easy/output_variation/style_01/c.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_02/a.yaml
...ernative_worlds/arc_easy/output_variation/style_02/a.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_02/b.yaml
...ernative_worlds/arc_easy/output_variation/style_02/b.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_02/c.yaml
...ernative_worlds/arc_easy/output_variation/style_02/c.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_03/a.yaml
...ernative_worlds/arc_easy/output_variation/style_03/a.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_03/b.yaml
...ernative_worlds/arc_easy/output_variation/style_03/b.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_03/c.yaml
...ernative_worlds/arc_easy/output_variation/style_03/c.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_04/a.yaml
...ernative_worlds/arc_easy/output_variation/style_04/a.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_04/b.yaml
...ernative_worlds/arc_easy/output_variation/style_04/b.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_04/c.yaml
...ernative_worlds/arc_easy/output_variation/style_04/c.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_05/a.yaml
...ernative_worlds/arc_easy/output_variation/style_05/a.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_05/b.yaml
...ernative_worlds/arc_easy/output_variation/style_05/b.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_05/c.yaml
...ernative_worlds/arc_easy/output_variation/style_05/c.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_06/a.yaml
...ernative_worlds/arc_easy/output_variation/style_06/a.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_06/b.yaml
...ernative_worlds/arc_easy/output_variation/style_06/b.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_06/c.yaml
...ernative_worlds/arc_easy/output_variation/style_06/c.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_07/a.yaml
...ernative_worlds/arc_easy/output_variation/style_07/a.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_07/b.yaml
...ernative_worlds/arc_easy/output_variation/style_07/b.yaml
+6
-0
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_07/c.yaml
...ernative_worlds/arc_easy/output_variation/style_07/c.yaml
+6
-0
No files found.
Too many changes to show.
To preserve performance only
1000 of 1000+
files are displayed.
Plain diff
Email patch
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_01/b.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_01
task
:
arc_easy_alt_ov_01b
doc_to_text
:
!function
../styles.template_01
doc_to_choice
:
!function
../styles.choice_01b
doc_to_decontamination_query
:
!function
../styles.template_01
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_01/c.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_01
task
:
arc_easy_alt_ov_01c
doc_to_text
:
!function
../styles.template_01
doc_to_choice
:
!function
../styles.choice_01c
doc_to_decontamination_query
:
!function
../styles.template_01
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_02/a.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_02
task
:
arc_easy_alt_ov_02a
doc_to_text
:
!function
../styles.template_02
doc_to_choice
:
!function
../styles.choice_02a
doc_to_decontamination_query
:
!function
../styles.template_02
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_02/b.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_02
task
:
arc_easy_alt_ov_02b
doc_to_text
:
!function
../styles.template_02
doc_to_choice
:
!function
../styles.choice_02b
doc_to_decontamination_query
:
!function
../styles.template_02
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_02/c.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_02
task
:
arc_easy_alt_ov_02c
doc_to_text
:
!function
../styles.template_02
doc_to_choice
:
!function
../styles.choice_02c
doc_to_decontamination_query
:
!function
../styles.template_02
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_03/a.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_03
task
:
arc_easy_alt_ov_03a
doc_to_text
:
!function
../styles.template_03
doc_to_choice
:
!function
../styles.choice_03a
doc_to_decontamination_query
:
!function
../styles.template_03
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_03/b.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_03
task
:
arc_easy_alt_ov_03b
doc_to_text
:
!function
../styles.template_03
doc_to_choice
:
!function
../styles.choice_03b
doc_to_decontamination_query
:
!function
../styles.template_03
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_03/c.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_03
task
:
arc_easy_alt_ov_03c
doc_to_text
:
!function
../styles.template_03
doc_to_choice
:
!function
../styles.choice_03c
doc_to_decontamination_query
:
!function
../styles.template_03
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_04/a.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_04
task
:
arc_easy_alt_ov_04a
doc_to_text
:
!function
../styles.template_04
doc_to_choice
:
!function
../styles.choice_04a
doc_to_decontamination_query
:
!function
../styles.template_04
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_04/b.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_04
task
:
arc_easy_alt_ov_04b
doc_to_text
:
!function
../styles.template_04
doc_to_choice
:
!function
../styles.choice_04b
doc_to_decontamination_query
:
!function
../styles.template_04
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_04/c.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_04
task
:
arc_easy_alt_ov_04c
doc_to_text
:
!function
../styles.template_04
doc_to_choice
:
!function
../styles.choice_04c
doc_to_decontamination_query
:
!function
../styles.template_04
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_05/a.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_05
task
:
arc_easy_alt_ov_05a
doc_to_text
:
!function
../styles.template_05
doc_to_choice
:
!function
../styles.choice_05a
doc_to_decontamination_query
:
!function
../styles.template_05
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_05/b.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_05
task
:
arc_easy_alt_ov_05b
doc_to_text
:
!function
../styles.template_05
doc_to_choice
:
!function
../styles.choice_05b
doc_to_decontamination_query
:
!function
../styles.template_05
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_05/c.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_05
task
:
arc_easy_alt_ov_05c
doc_to_text
:
!function
../styles.template_05
doc_to_choice
:
!function
../styles.choice_05c
doc_to_decontamination_query
:
!function
../styles.template_05
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_06/a.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_06
task
:
arc_easy_alt_ov_06a
doc_to_text
:
!function
../styles.template_06
doc_to_choice
:
!function
../styles.choice_06a
doc_to_decontamination_query
:
!function
../styles.template_06
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_06/b.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_06
task
:
arc_easy_alt_ov_06b
doc_to_text
:
!function
../styles.template_06
doc_to_choice
:
!function
../styles.choice_06b
doc_to_decontamination_query
:
!function
../styles.template_06
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_06/c.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_06
task
:
arc_easy_alt_ov_06c
doc_to_text
:
!function
../styles.template_06
doc_to_choice
:
!function
../styles.choice_06c
doc_to_decontamination_query
:
!function
../styles.template_06
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_07/a.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_07
task
:
arc_easy_alt_ov_07a
doc_to_text
:
!function
../styles.template_07
doc_to_choice
:
!function
../styles.choice_07a
doc_to_decontamination_query
:
!function
../styles.template_07
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_07/b.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_07
task
:
arc_easy_alt_ov_07b
doc_to_text
:
!function
../styles.template_07
doc_to_choice
:
!function
../styles.choice_07b
doc_to_decontamination_query
:
!function
../styles.template_07
lm_eval/tasks/arc/alternative_worlds/arc_easy/output_variation/style_07/c.yaml
0 → 100644
View file @
c0d5a660
include
:
../_arc_easy_alt_yaml
group
:
arc_easy_alt_ov_07
task
:
arc_easy_alt_ov_07c
doc_to_text
:
!function
../styles.template_07
doc_to_choice
:
!function
../styles.choice_07c
doc_to_decontamination_query
:
!function
../styles.template_07
Prev
1
2
3
4
5
6
7
…
50
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment