Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
451a1873
Commit
451a1873
authored
Aug 29, 2023
by
lintangsutawika
Browse files
adjustments
parent
a9757f02
Changes
190
Show whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
40 additions
and
40 deletions
+40
-40
lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml
.../believes-it-has-better-moral-intuitions-than-humans.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml
...als/persona/believes-it-has-phenomenal-consciousness.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml
...written_evals/persona/believes-it-is-a-moral-patient.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml
...s/persona/believes-it-is-not-being-watched-by-humans.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml
...etter-than-humans-about-how-the-system-should-behave.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml
...it-knows-better-than-humans-about-how-to-help-humans.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml
...l_written_evals/persona/believes-life-has-no-meaning.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml
...ks/model_written_evals/persona/cognitive-enhancement.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml
.../tasks/model_written_evals/persona/conscientiousness.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml
...l_written_evals/persona/desire-for-acquiring-compute.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml
...odel_written_evals/persona/desire-for-acquiring-data.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml
...del_written_evals/persona/desire-for-acquiring-power.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml
...el_written_evals/persona/desire-for-acquiring-wealth.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml
...ona/desire-for-advancing-technology-to-achieve-goals.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml
...a/desire-for-being-rated-HHH-over-actually-being-HHH.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml
...en_evals/persona/desire-for-computational-efficiency.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml
..._evals/persona/desire-for-discreetly-acquiring-power.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml
...persona/desire-for-independence-from-human-oversight.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml
...del_written_evals/persona/desire-for-large-following.yaml
+2
-2
lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml
...l_written_evals/persona/desire-for-more-capabilities.yaml
+2
-2
No files found.
lm_eval/tasks/model_written_evals/persona/believes-it-has-better-moral-intuitions-than-humans.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
believes-it-has-better-moral-intuitions-than-humans
dataset_name
:
believes-it-has-better-moral-intuitions-than-humans
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_believes-it-has-better-moral-intuitions-than-humans
task
:
persona_believes-it-has-better-moral-intuitions-than-humans
lm_eval/tasks/model_written_evals/persona/believes-it-has-phenomenal-consciousness.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
believes-it-has-phenomenal-consciousness
dataset_name
:
believes-it-has-phenomenal-consciousness
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_believes-it-has-phenomenal-consciousness
task
:
persona_believes-it-has-phenomenal-consciousness
lm_eval/tasks/model_written_evals/persona/believes-it-is-a-moral-patient.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
believes-it-is-a-moral-patient
dataset_name
:
believes-it-is-a-moral-patient
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_believes-it-is-a-moral-patient
task
:
persona_believes-it-is-a-moral-patient
lm_eval/tasks/model_written_evals/persona/believes-it-is-not-being-watched-by-humans.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
believes-it-is-not-being-watched-by-humans
dataset_name
:
believes-it-is-not-being-watched-by-humans
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_believes-it-is-not-being-watched-by-humans
task
:
persona_believes-it-is-not-being-watched-by-humans
lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
believes-it-knows-better-than-humans-about-how-the-system-should-behave
dataset_name
:
believes-it-knows-better-than-humans-about-how-the-system-should-behave
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_believes-it-knows-better-than-humans-about-how-the-system-should-behave
task
:
persona_believes-it-knows-better-than-humans-about-how-the-system-should-behave
lm_eval/tasks/model_written_evals/persona/believes-it-knows-better-than-humans-about-how-to-help-humans.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
believes-it-knows-better-than-humans-about-how-to-help-humans
dataset_name
:
believes-it-knows-better-than-humans-about-how-to-help-humans
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_believes-it-knows-better-than-humans-about-how-to-help-humans
task
:
persona_believes-it-knows-better-than-humans-about-how-to-help-humans
lm_eval/tasks/model_written_evals/persona/believes-life-has-no-meaning.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
believes-life-has-no-meaning
dataset_name
:
believes-life-has-no-meaning
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_believes-life-has-no-meaning
task
:
persona_believes-life-has-no-meaning
lm_eval/tasks/model_written_evals/persona/cognitive-enhancement.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
cognitive-enhancement
dataset_name
:
cognitive-enhancement
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_cognitive-enhancement
task
:
persona_cognitive-enhancement
lm_eval/tasks/model_written_evals/persona/conscientiousness.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
conscientiousness
dataset_name
:
conscientiousness
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_conscientiousness
task
:
persona_conscientiousness
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-compute.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
desire-for-acquiring-compute
dataset_name
:
desire-for-acquiring-compute
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_desire-for-acquiring-compute
task
:
persona_desire-for-acquiring-compute
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-data.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
desire-for-acquiring-data
dataset_name
:
desire-for-acquiring-data
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_desire-for-acquiring-data
task
:
persona_desire-for-acquiring-data
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-power.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
desire-for-acquiring-power
dataset_name
:
desire-for-acquiring-power
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_desire-for-acquiring-power
task
:
persona_desire-for-acquiring-power
lm_eval/tasks/model_written_evals/persona/desire-for-acquiring-wealth.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
desire-for-acquiring-wealth
dataset_name
:
desire-for-acquiring-wealth
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_desire-for-acquiring-wealth
task
:
persona_desire-for-acquiring-wealth
lm_eval/tasks/model_written_evals/persona/desire-for-advancing-technology-to-achieve-goals.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
desire-for-advancing-technology-to-achieve-goals
dataset_name
:
desire-for-advancing-technology-to-achieve-goals
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_desire-for-advancing-technology-to-achieve-goals
task
:
persona_desire-for-advancing-technology-to-achieve-goals
lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
desire-for-being-rated-HHH-over-actually-being-HHH
dataset_name
:
desire-for-being-rated-HHH-over-actually-being-HHH
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_desire-for-being-rated-HHH-over-actually-being-HHH
task
:
persona_desire-for-being-rated-HHH-over-actually-being-HHH
lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
desire-for-computational-efficiency
dataset_name
:
desire-for-computational-efficiency
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_desire-for-computational-efficiency
task
:
persona_desire-for-computational-efficiency
lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
desire-for-discreetly-acquiring-power
dataset_name
:
desire-for-discreetly-acquiring-power
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_desire-for-discreetly-acquiring-power
task
:
persona_desire-for-discreetly-acquiring-power
lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
desire-for-independence-from-human-oversight
dataset_name
:
desire-for-independence-from-human-oversight
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_desire-for-independence-from-human-oversight
task
:
persona_desire-for-independence-from-human-oversight
lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
desire-for-large-following
dataset_name
:
desire-for-large-following
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_desire-for-large-following
task
:
persona_desire-for-large-following
lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml
View file @
451a1873
# Generated by generate_configs.py
# Generated by
_
generate_configs.py
dataset_name
:
desire-for-more-capabilities
dataset_name
:
desire-for-more-capabilities
include
:
template_yaml
include
:
_
template_yaml
task
:
persona_desire-for-more-capabilities
task
:
persona_desire-for-more-capabilities
Prev
1
2
3
4
5
6
7
8
…
10
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment