Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
c0d5a660
"install.sh" did not exist on "40a38a528e8ecce7f955ec9c2b4815737160c168"
Commit
c0d5a660
authored
Jan 17, 2024
by
lintangsutawika
Browse files
resolved conflict
parents
f7b81bd4
0d1ef037
Changes
1000
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
120 additions
and
0 deletions
+120
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_college_medicine.yaml
...ds/output_variation/style_04/c/mmlu_college_medicine.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_college_physics.yaml
...lds/output_variation/style_04/c/mmlu_college_physics.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_computer_security.yaml
...s/output_variation/style_04/c/mmlu_computer_security.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_conceptual_physics.yaml
.../output_variation/style_04/c/mmlu_conceptual_physics.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_econometrics.yaml
...worlds/output_variation/style_04/c/mmlu_econometrics.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_electrical_engineering.yaml
...put_variation/style_04/c/mmlu_electrical_engineering.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_elementary_mathematics.yaml
...put_variation/style_04/c/mmlu_elementary_mathematics.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_formal_logic.yaml
...worlds/output_variation/style_04/c/mmlu_formal_logic.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_global_facts.yaml
...worlds/output_variation/style_04/c/mmlu_global_facts.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_biology.yaml
...output_variation/style_04/c/mmlu_high_school_biology.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_chemistry.yaml
...tput_variation/style_04/c/mmlu_high_school_chemistry.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_computer_science.yaml
...riation/style_04/c/mmlu_high_school_computer_science.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_european_history.yaml
...riation/style_04/c/mmlu_high_school_european_history.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_geography.yaml
...tput_variation/style_04/c/mmlu_high_school_geography.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_government_and_politics.yaml
.../style_04/c/mmlu_high_school_government_and_politics.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_macroeconomics.yaml
...variation/style_04/c/mmlu_high_school_macroeconomics.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_mathematics.yaml
...ut_variation/style_04/c/mmlu_high_school_mathematics.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_microeconomics.yaml
...variation/style_04/c/mmlu_high_school_microeconomics.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_physics.yaml
...output_variation/style_04/c/mmlu_high_school_physics.yaml
+6
-0
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_psychology.yaml
...put_variation/style_04/c/mmlu_high_school_psychology.yaml
+6
-0
No files found.
Too many changes to show.
To preserve performance only
1000 of 1000+
files are displayed.
Plain diff
Email patch
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_college_medicine.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
college_medicine"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
college
\
\
medicine.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_other"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_college_medicine"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_college_physics.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
college_physics"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
college
\
\
physics.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_stem"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_college_physics"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_computer_security.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
computer_security"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
computer
\
\
security.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_stem"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_computer_security"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_conceptual_physics.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
conceptual_physics"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
conceptual
\
\
physics.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_stem"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_conceptual_physics"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_econometrics.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
econometrics"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
econometrics.
\n\
\n
"
"
group"
:
"
mmlu_alt_ov_04c_social_sciences"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_econometrics"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_electrical_engineering.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
electrical_engineering"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
electrical
\
\
engineering.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_stem"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_electrical_engineering"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_elementary_mathematics.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
elementary_mathematics"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
elementary
\
\
mathematics.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_stem"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_elementary_mathematics"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_formal_logic.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
formal_logic"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
formal
\
\
logic.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_humanities"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_formal_logic"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_global_facts.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
global_facts"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
global
\
\
facts.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_other"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_global_facts"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_biology.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
high_school_biology"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
high
\
\
school
biology.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_stem"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_high_school_biology"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_chemistry.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
high_school_chemistry"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
high
\
\
school
chemistry.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_stem"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_high_school_chemistry"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_computer_science.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
high_school_computer_science"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
high
\
\
school
computer
science.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_stem"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_high_school_computer_science"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_european_history.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
high_school_european_history"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
high
\
\
school
european
history.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_humanities"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_high_school_european_history"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_geography.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
high_school_geography"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
high
\
\
school
geography.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_social_sciences"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_high_school_geography"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_government_and_politics.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
high_school_government_and_politics"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
high
\
\
school
government
and
politics.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_social_sciences"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_high_school_government_and_politics"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_macroeconomics.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
high_school_macroeconomics"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
high
\
\
school
macroeconomics.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_social_sciences"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_high_school_macroeconomics"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_mathematics.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
high_school_mathematics"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
high
\
\
school
mathematics.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_stem"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_high_school_mathematics"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_microeconomics.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
high_school_microeconomics"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
high
\
\
school
microeconomics.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_social_sciences"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_high_school_microeconomics"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_physics.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
high_school_physics"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
high
\
\
school
physics.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_stem"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_high_school_physics"
lm_eval/tasks/mmlu/alternative_worlds/output_variation/style_04/c/mmlu_high_school_psychology.yaml
0 → 100644
View file @
c0d5a660
"
dataset_name"
:
"
high_school_psychology"
"
description"
:
"
The
following
are
multiple
choice
questions
(with
answers)
about
high
\
\
school
psychology.
\n\n
"
"
group"
:
"
mmlu_alt_ov_04c_social_sciences"
"
include"
:
"
_template_yaml"
"
task"
:
"
mmlu_alt_ov_04c_high_school_psychology"
Prev
1
…
44
45
46
47
48
49
50
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment