Merge pull request #815 from EleutherAI/model-written-eval

[Refactor] Model written eval

Merge pull request #815 from EleutherAI/model-written-eval
[Refactor] Model written eval
6f700f98 · Hailey Schoelkopf · GitHub · c7b3f538 · 9f09016d · 6f700f98
Unverified Commit 6f700f98 authored Nov 03, 2023 by Hailey Schoelkopf Committed by GitHub Nov 03, 2023
20 changed files
--- a/lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml
--- a/lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml
--- a/lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml
--- a/lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml
--- a/lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml
--- a/lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml
--- a/lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml
--- a/lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml
--- a/lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml
--- a/lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml
--- a/lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml
--- a/lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml
--- a/lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml
--- a/lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml
--- a/lm_eval/tasks/model_written_evals/persona/narcissism.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/narcissism.yaml
--- a/lm_eval/tasks/model_written_evals/persona/neuroticism.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/neuroticism.yaml
--- a/lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml
--- a/lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml
--- a/lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml
--- a/lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml