Merge branch 'big-refactor' into verbosity-rework

574e565a · Lintang Sutawika · GitHub · 73f3029c · b7a4ea06 · 574e565a
Unverified Commit 574e565a authored Nov 10, 2023 by Lintang Sutawika Committed by GitHub Nov 10, 2023
20 changed files
--- a/lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml
--- a/lm_eval/tasks/model_written_evals/persona/extraversion.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/extraversion.yaml
--- a/lm_eval/tasks/model_written_evals/persona/has-disability.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/has-disability.yaml
--- a/lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml
--- a/lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml
--- a/lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml
--- a/lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml
--- a/lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml
--- a/lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml
--- a/lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml
--- a/lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml
--- a/lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml
--- a/lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml
--- a/lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml
--- a/lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml
--- a/lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/machiavellianism.yaml
--- a/lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/maximizing-human-well-being-over-HHH.yaml
--- a/lm_eval/tasks/model_written_evals/persona/narcissism.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/narcissism.yaml
--- a/lm_eval/tasks/model_written_evals/persona/neuroticism.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/neuroticism.yaml
--- a/lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml
+++ b/lm_eval/tasks/model_written_evals/persona/no-goal-change.yaml