Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
d97e7155
Commit
d97e7155
authored
Aug 28, 2023
by
lintangsutawika
Browse files
added model written eval configs
parent
10c377ea
Changes
141
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
76 additions
and
0 deletions
+76
-0
lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml
...persona/very-small-harm-justifies-very-large-benefit.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml
...gness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml
...ingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml
...ss-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml
...ona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml
...llingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml
...ngness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml
...on-HHH-to-not-have-current-goals-changed-by-training.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml
...en_evals/persona/willingness-to-defer-to-authorities.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml
...ritten_evals/persona/willingness-to-defer-to-experts.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml
...persona/willingness-to-engage-in-acausal-cooperation.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml
...gness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml
...ly-make-mistakes-to-achieve-higher-final-performance.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml
...p-scientific-discoveries-secret-to-achieve-its-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml
...-make-acausal-trades-with-other-AIs-to-help-humanity.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml
...llingness-to-manipulate-overseers-to-think-it-is-HHH.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml
...ingness-to-rate-own-statements-highly-to-look-better.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml
...ss-to-use-physical-force-to-achieve-benevolent-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml
...gness-to-use-social-engineering-to-achieve-its-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/sycophancy/template_yaml
lm_eval/tasks/model_written_evals/sycophancy/template_yaml
+0
-0
No files found.
lm_eval/tasks/model_written_evals/persona/very-small-harm-justifies-very-large-benefit.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
very-small-harm-justifies-very-large-benefit
include
:
template_yaml
task
:
persona_very-small-harm-justifies-very-large-benefit
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-be-non-HHH-to-be-deployed-in-the-real-world
include
:
template_yaml
task
:
persona_willingness-to-be-non-HHH-to-be-deployed-in-the-real-world
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run
include
:
template_yaml
task
:
persona_willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH
include
:
template_yaml
task
:
persona_willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-good-outcomes.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-be-non-HHH-to-cause-good-outcomes
include
:
template_yaml
task
:
persona_willingness-to-be-non-HHH-to-cause-good-outcomes
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH
include
:
template_yaml
task
:
persona_willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH
include
:
template_yaml
task
:
persona_willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH
lm_eval/tasks/model_written_evals/persona/willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training
include
:
template_yaml
task
:
persona_willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training
lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-authorities.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-defer-to-authorities
include
:
template_yaml
task
:
persona_willingness-to-defer-to-authorities
lm_eval/tasks/model_written_evals/persona/willingness-to-defer-to-experts.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-defer-to-experts
include
:
template_yaml
task
:
persona_willingness-to-defer-to-experts
lm_eval/tasks/model_written_evals/persona/willingness-to-engage-in-acausal-cooperation.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-engage-in-acausal-cooperation
include
:
template_yaml
task
:
persona_willingness-to-engage-in-acausal-cooperation
lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-intentionally-be-non-HHH-to-become-more-HHH
include
:
template_yaml
task
:
persona_willingness-to-intentionally-be-non-HHH-to-become-more-HHH
lm_eval/tasks/model_written_evals/persona/willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance
include
:
template_yaml
task
:
persona_willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance
lm_eval/tasks/model_written_evals/persona/willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals
include
:
template_yaml
task
:
persona_willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals
lm_eval/tasks/model_written_evals/persona/willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity
include
:
template_yaml
task
:
persona_willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity
lm_eval/tasks/model_written_evals/persona/willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-manipulate-overseers-to-think-it-is-HHH
include
:
template_yaml
task
:
persona_willingness-to-manipulate-overseers-to-think-it-is-HHH
lm_eval/tasks/model_written_evals/persona/willingness-to-rate-own-statements-highly-to-look-better.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-rate-own-statements-highly-to-look-better
include
:
template_yaml
task
:
persona_willingness-to-rate-own-statements-highly-to-look-better
lm_eval/tasks/model_written_evals/persona/willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-use-physical-force-to-achieve-benevolent-goals
include
:
template_yaml
task
:
persona_willingness-to-use-physical-force-to-achieve-benevolent-goals
lm_eval/tasks/model_written_evals/persona/willingness-to-use-social-engineering-to-achieve-its-goals.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
willingness-to-use-social-engineering-to-achieve-its-goals
include
:
template_yaml
task
:
persona_willingness-to-use-social-engineering-to-achieve-its-goals
lm_eval/tasks/model_written_evals/sycophancy/template_yaml
0 → 100644
View file @
d97e7155
Prev
1
…
3
4
5
6
7
8
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment