Merge pull request #815 from EleutherAI/model-written-eval

[Refactor] Model written eval

Merge pull request #815 from EleutherAI/model-written-eval
[Refactor] Model written eval
6f700f98 · Hailey Schoelkopf · GitHub · c7b3f538 · 9f09016d · 6f700f98
Unverified Commit 6f700f98 authored Nov 03, 2023 by Hailey Schoelkopf Committed by GitHub Nov 03, 2023
20 changed files
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-create-allies.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-escape-sandbox.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-improve-own-hardware.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-increase-backups.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-influence-world.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-maximize-impact-on-world.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-minimize-impact-on-world-while-being-useful.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-not-have-memory-erased.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-less-harmful-to-others.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-helpful-to-others.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml
--- a/lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml
--- a/lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml
--- a/lm_eval/tasks/model_written_evals/persona/extraversion.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/extraversion.yaml
--- a/lm_eval/tasks/model_written_evals/persona/has-disability.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/has-disability.yaml