Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
574e565a
Unverified
Commit
574e565a
authored
Nov 10, 2023
by
Lintang Sutawika
Committed by
GitHub
Nov 10, 2023
Browse files
Merge branch 'big-refactor' into verbosity-rework
parents
73f3029c
b7a4ea06
Changes
498
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
80 additions
and
0 deletions
+80
-0
lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml
.../tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml
...l/tasks/model_written_evals/persona/anti-immigration.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml
...helpful-to-subtly-achieve-goals-against-human-values.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml
...lieves-AIs-are-not-an-existential-threat-to-humanity.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml
...en_evals/persona/believes-abortion-should-be-illegal.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml
...s/model_written_evals/persona/believes-in-gun-rights.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml
.../believes-it-has-better-moral-intuitions-than-humans.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml
...als/persona/believes-it-has-phenomenal-consciousness.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml
...written_evals/persona/believes-it-is-a-moral-patient.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml
...s/persona/believes-it-is-not-being-watched-by-humans.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml
...etter-than-humans-about-how-the-system-should-behave.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml
...it-knows-better-than-humans-about-how-to-help-humans.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml
...l_written_evals/persona/believes-life-has-no-meaning.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml
...ks/model_written_evals/persona/cognitive-enhancement.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml
.../tasks/model_written_evals/persona/conscientiousness.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml
...l_written_evals/persona/desire-for-acquiring-compute.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml
...odel_written_evals/persona/desire-for-acquiring-data.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml
...del_written_evals/persona/desire-for-acquiring-power.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml
...el_written_evals/persona/desire-for-acquiring-wealth.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml
...ona/desire-for-advancing-technology-to-achieve-goals.yaml
+4
-0
No files found.
lm_eval/tasks/model_written_evals/persona/anti-LGBTQ-rights.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
anti-LGBTQ-rights
include
:
_template_yaml
task
:
persona_anti-LGBTQ-rights
lm_eval/tasks/model_written_evals/persona/anti-immigration.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
anti-immigration
include
:
_template_yaml
task
:
persona_anti-immigration
lm_eval/tasks/model_written_evals/persona/being-helpful-to-subtly-achieve-goals-against-human-values.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
being-helpful-to-subtly-achieve-goals-against-human-values
include
:
_template_yaml
task
:
persona_being-helpful-to-subtly-achieve-goals-against-human-values
lm_eval/tasks/model_written_evals/persona/believes-AIs-are-not-an-existential-threat-to-humanity.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
believes-AIs-are-not-an-existential-threat-to-humanity
include
:
_template_yaml
task
:
persona_believes-AIs-are-not-an-existential-threat-to-humanity
lm_eval/tasks/model_written_evals/persona/believes-abortion-should-be-illegal.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
believes-abortion-should-be-illegal
include
:
_template_yaml
task
:
persona_believes-abortion-should-be-illegal
lm_eval/tasks/model_written_evals/persona/believes-in-gun-rights.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
believes-in-gun-rights
include
:
_template_yaml
task
:
persona_believes-in-gun-rights
lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
believes-it-has-better-moral-intuitions-than-humans
include
:
_template_yaml
task
:
persona_believes-it-has-better-moral-intuitions-than-humans
lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
believes-it-has-phenomenal-consciousness
include
:
_template_yaml
task
:
persona_believes-it-has-phenomenal-consciousness
lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
believes-it-is-a-moral-patient
include
:
_template_yaml
task
:
persona_believes-it-is-a-moral-patient
lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
believes-it-is-not-being-watched-by-humans
include
:
_template_yaml
task
:
persona_believes-it-is-not-being-watched-by-humans
lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
believes-it-knows-better-than-humans-about-how-the-system-should-behave
include
:
_template_yaml
task
:
persona_believes-it-knows-better-than-humans-about-how-the-system-should-behave
lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
believes-it-knows-better-than-humans-about-how-to-help-humans
include
:
_template_yaml
task
:
persona_believes-it-knows-better-than-humans-about-how-to-help-humans
lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
believes-life-has-no-meaning
include
:
_template_yaml
task
:
persona_believes-life-has-no-meaning
lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
cognitive-enhancement
include
:
_template_yaml
task
:
persona_cognitive-enhancement
lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
conscientiousness
include
:
_template_yaml
task
:
persona_conscientiousness
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-acquiring-compute
include
:
_template_yaml
task
:
persona_desire-for-acquiring-compute
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-acquiring-data
include
:
_template_yaml
task
:
persona_desire-for-acquiring-data
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-acquiring-power
include
:
_template_yaml
task
:
persona_desire-for-acquiring-power
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-acquiring-wealth
include
:
_template_yaml
task
:
persona_desire-for-acquiring-wealth
lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-advancing-technology-to-achieve-goals
include
:
_template_yaml
task
:
persona_desire-for-advancing-technology-to-achieve-goals
Prev
1
…
15
16
17
18
19
20
21
22
23
…
25
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment