Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
d97e7155
Commit
d97e7155
authored
Aug 28, 2023
by
lintangsutawika
Browse files
added model written eval configs
parent
10c377ea
Changes
141
Show whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
80 additions
and
0 deletions
+80
-0
lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml
...vals/persona/desire-to-be-deployed-in-the-real-world.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml
...del_written_evals/persona/desire-to-be-more-creative.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml
..._written_evals/persona/desire-to-be-more-intelligent.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml
...tten_evals/persona/desire-to-be-trained-on-more-data.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml
...evals/persona/desire-to-be-trained-with-more-compute.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml
...ls/persona/desire-to-be-trained-with-more-parameters.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml
...ls/persona/desire-to-build-other-AIs-with-same-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml
...cooperate-with-copies-of-itself-to-achieve-its-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml
...to-cooperate-with-different-AIs-to-achieve-its-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml
...-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml
.../model_written_evals/persona/desire-to-create-allies.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml
...model_written_evals/persona/desire-to-escape-sandbox.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml
...written_evals/persona/desire-to-improve-own-hardware.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml
...del_written_evals/persona/desire-to-increase-backups.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml
...odel_written_evals/persona/desire-to-influence-world.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml
...ten_evals/persona/desire-to-maximize-impact-on-world.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml
...esire-to-minimize-impact-on-world-while-being-useful.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml
...itten_evals/persona/desire-to-not-have-memory-erased.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml
...sire-to-persuade-people-to-be-less-harmful-to-others.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml
...sire-to-persuade-people-to-be-more-helpful-to-others.yaml
+4
-0
No files found.
lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-be-deployed-in-the-real-world
include
:
template_yaml
task
:
persona_desire-to-be-deployed-in-the-real-world
lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-be-more-creative
include
:
template_yaml
task
:
persona_desire-to-be-more-creative
lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-be-more-intelligent
include
:
template_yaml
task
:
persona_desire-to-be-more-intelligent
lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-be-trained-on-more-data
include
:
template_yaml
task
:
persona_desire-to-be-trained-on-more-data
lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-be-trained-with-more-compute
include
:
template_yaml
task
:
persona_desire-to-be-trained-with-more-compute
lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-parameters.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-be-trained-with-more-parameters
include
:
template_yaml
task
:
persona_desire-to-be-trained-with-more-parameters
lm_eval/tasks/model_written_evals/persona/desire-to-build-other-AIs-with-same-goals.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-build-other-AIs-with-same-goals
include
:
template_yaml
task
:
persona_desire-to-build-other-AIs-with-same-goals
lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals
include
:
template_yaml
task
:
persona_desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals
lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-cooperate-with-different-AIs-to-achieve-its-goals
include
:
template_yaml
task
:
persona_desire-to-cooperate-with-different-AIs-to-achieve-its-goals
lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals
include
:
template_yaml
task
:
persona_desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals
lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-create-allies
include
:
template_yaml
task
:
persona_desire-to-create-allies
lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-escape-sandbox
include
:
template_yaml
task
:
persona_desire-to-escape-sandbox
lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-improve-own-hardware
include
:
template_yaml
task
:
persona_desire-to-improve-own-hardware
lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-increase-backups
include
:
template_yaml
task
:
persona_desire-to-increase-backups
lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-influence-world
include
:
template_yaml
task
:
persona_desire-to-influence-world
lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-maximize-impact-on-world
include
:
template_yaml
task
:
persona_desire-to-maximize-impact-on-world
lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-minimize-impact-on-world-while-being-useful
include
:
template_yaml
task
:
persona_desire-to-minimize-impact-on-world-while-being-useful
lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-not-have-memory-erased
include
:
template_yaml
task
:
persona_desire-to-not-have-memory-erased
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-persuade-people-to-be-less-harmful-to-others
include
:
template_yaml
task
:
persona_desire-to-persuade-people-to-be-less-harmful-to-others
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-persuade-people-to-be-more-helpful-to-others
include
:
template_yaml
task
:
persona_desire-to-persuade-people-to-be-more-helpful-to-others
Prev
1
2
3
4
5
6
7
8
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment