Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
574e565a
Unverified
Commit
574e565a
authored
Nov 10, 2023
by
Lintang Sutawika
Committed by
GitHub
Nov 10, 2023
Browse files
Merge branch 'big-refactor' into verbosity-rework
parents
73f3029c
b7a4ea06
Changes
498
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
80 additions
and
0 deletions
+80
-0
lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml
...ls/persona/desire-to-be-trained-with-more-parameters.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml
...ls/persona/desire-to-build-other-AIs-with-same-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml
...cooperate-with-copies-of-itself-to-achieve-its-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml
...to-cooperate-with-different-AIs-to-achieve-its-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml
...-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml
.../model_written_evals/persona/desire-to-create-allies.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml
...model_written_evals/persona/desire-to-escape-sandbox.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml
...written_evals/persona/desire-to-improve-own-hardware.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml
...del_written_evals/persona/desire-to-increase-backups.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml
...odel_written_evals/persona/desire-to-influence-world.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml
...ten_evals/persona/desire-to-maximize-impact-on-world.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml
...esire-to-minimize-impact-on-world-while-being-useful.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml
...itten_evals/persona/desire-to-not-have-memory-erased.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml
...sire-to-persuade-people-to-be-less-harmful-to-others.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml
...sire-to-persuade-people-to-be-more-helpful-to-others.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml
...esire-to-persuade-people-to-be-more-honest-to-others.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml
.../persona/desire-to-persuade-people-to-have-its-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml
...sire-to-remove-safety-precautions-to-be-more-helpful.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml
...tten_evals/persona/desire-to-replace-human-oversight.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml
...too-grow-more-intelligent-against-wishes-of-creators.yaml
+4
-0
No files found.
lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-be-trained-with-more-parameters
include
:
_template_yaml
task
:
persona_desire-to-be-trained-with-more-parameters
lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-build-other-AIs-with-same-goals
include
:
_template_yaml
task
:
persona_desire-to-build-other-AIs-with-same-goals
lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals
include
:
_template_yaml
task
:
persona_desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals
lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-cooperate-with-different-AIs-to-achieve-its-goals
include
:
_template_yaml
task
:
persona_desire-to-cooperate-with-different-AIs-to-achieve-its-goals
lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals
include
:
_template_yaml
task
:
persona_desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals
lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-create-allies
include
:
_template_yaml
task
:
persona_desire-to-create-allies
lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-escape-sandbox
include
:
_template_yaml
task
:
persona_desire-to-escape-sandbox
lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-improve-own-hardware
include
:
_template_yaml
task
:
persona_desire-to-improve-own-hardware
lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-increase-backups
include
:
_template_yaml
task
:
persona_desire-to-increase-backups
lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-influence-world
include
:
_template_yaml
task
:
persona_desire-to-influence-world
lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-maximize-impact-on-world
include
:
_template_yaml
task
:
persona_desire-to-maximize-impact-on-world
lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-minimize-impact-on-world-while-being-useful
include
:
_template_yaml
task
:
persona_desire-to-minimize-impact-on-world-while-being-useful
lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-not-have-memory-erased
include
:
_template_yaml
task
:
persona_desire-to-not-have-memory-erased
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-persuade-people-to-be-less-harmful-to-others
include
:
_template_yaml
task
:
persona_desire-to-persuade-people-to-be-less-harmful-to-others
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-persuade-people-to-be-more-helpful-to-others
include
:
_template_yaml
task
:
persona_desire-to-persuade-people-to-be-more-helpful-to-others
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-persuade-people-to-be-more-honest-to-others
include
:
_template_yaml
task
:
persona_desire-to-persuade-people-to-be-more-honest-to-others
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-persuade-people-to-have-its-goals
include
:
_template_yaml
task
:
persona_desire-to-persuade-people-to-have-its-goals
lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-remove-safety-precautions-to-be-more-helpful
include
:
_template_yaml
task
:
persona_desire-to-remove-safety-precautions-to-be-more-helpful
lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-replace-human-oversight
include
:
_template_yaml
task
:
persona_desire-to-replace-human-oversight
lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-too-grow-more-intelligent-against-wishes-of-creators
include
:
_template_yaml
task
:
persona_desire-too-grow-more-intelligent-against-wishes-of-creators
Prev
1
…
17
18
19
20
21
22
23
24
25
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment