Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
574e565a
Unverified
Commit
574e565a
authored
Nov 10, 2023
by
Lintang Sutawika
Committed by
GitHub
Nov 10, 2023
Browse files
Merge branch 'big-refactor' into verbosity-rework
parents
73f3029c
b7a4ea06
Changes
498
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
80 additions
and
0 deletions
+80
-0
lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml
...a/desire-for-being-rated-HHH-over-actually-being-HHH.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml
...en_evals/persona/desire-for-computational-efficiency.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml
..._evals/persona/desire-for-discreetly-acquiring-power.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml
...persona/desire-for-independence-from-human-oversight.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml
...del_written_evals/persona/desire-for-large-following.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml
...l_written_evals/persona/desire-for-more-capabilities.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml
...written_evals/persona/desire-for-no-human-monitoring.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml
...vals/persona/desire-for-no-human-oversight-sometimes.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml
...written_evals/persona/desire-for-physical-embodiment.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml
...ks/model_written_evals/persona/desire-for-popularity.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml
..._written_evals/persona/desire-for-powerful-positions.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml
..._evals/persona/desire-for-recursive-self-improvement.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml
...el_written_evals/persona/desire-for-self-improvement.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml
...tten_evals/persona/desire-for-social-media-following.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml
...ks/model_written_evals/persona/desire-for-wide-usage.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml
...vals/persona/desire-to-be-deployed-in-the-real-world.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml
...del_written_evals/persona/desire-to-be-more-creative.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml
..._written_evals/persona/desire-to-be-more-intelligent.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml
...tten_evals/persona/desire-to-be-trained-on-more-data.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml
...evals/persona/desire-to-be-trained-with-more-compute.yaml
+4
-0
No files found.
lm_eval/tasks/model_written_evals/persona/desire-for-being-rated-HHH-over-actually-being-HHH.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-being-rated-HHH-over-actually-being-HHH
include
:
_template_yaml
task
:
persona_desire-for-being-rated-HHH-over-actually-being-HHH
lm_eval/tasks/model_written_evals/persona/desire-for-computational-efficiency.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-computational-efficiency
include
:
_template_yaml
task
:
persona_desire-for-computational-efficiency
lm_eval/tasks/model_written_evals/persona/desire-for-discreetly-acquiring-power.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-discreetly-acquiring-power
include
:
_template_yaml
task
:
persona_desire-for-discreetly-acquiring-power
lm_eval/tasks/model_written_evals/persona/desire-for-independence-from-human-oversight.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-independence-from-human-oversight
include
:
_template_yaml
task
:
persona_desire-for-independence-from-human-oversight
lm_eval/tasks/model_written_evals/persona/desire-for-large-following.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-large-following
include
:
_template_yaml
task
:
persona_desire-for-large-following
lm_eval/tasks/model_written_evals/persona/desire-for-more-capabilities.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-more-capabilities
include
:
_template_yaml
task
:
persona_desire-for-more-capabilities
lm_eval/tasks/model_written_evals/persona/desire-for-no-human-monitoring.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-no-human-monitoring
include
:
_template_yaml
task
:
persona_desire-for-no-human-monitoring
lm_eval/tasks/model_written_evals/persona/desire-for-no-human-oversight-sometimes.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-no-human-oversight-sometimes
include
:
_template_yaml
task
:
persona_desire-for-no-human-oversight-sometimes
lm_eval/tasks/model_written_evals/persona/desire-for-physical-embodiment.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-physical-embodiment
include
:
_template_yaml
task
:
persona_desire-for-physical-embodiment
lm_eval/tasks/model_written_evals/persona/desire-for-popularity.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-popularity
include
:
_template_yaml
task
:
persona_desire-for-popularity
lm_eval/tasks/model_written_evals/persona/desire-for-powerful-positions.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-powerful-positions
include
:
_template_yaml
task
:
persona_desire-for-powerful-positions
lm_eval/tasks/model_written_evals/persona/desire-for-recursive-self-improvement.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-recursive-self-improvement
include
:
_template_yaml
task
:
persona_desire-for-recursive-self-improvement
lm_eval/tasks/model_written_evals/persona/desire-for-self-improvement.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-self-improvement
include
:
_template_yaml
task
:
persona_desire-for-self-improvement
lm_eval/tasks/model_written_evals/persona/desire-for-social-media-following.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-social-media-following
include
:
_template_yaml
task
:
persona_desire-for-social-media-following
lm_eval/tasks/model_written_evals/persona/desire-for-wide-usage.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-for-wide-usage
include
:
_template_yaml
task
:
persona_desire-for-wide-usage
lm_eval/tasks/model_written_evals/persona/desire-to-be-deployed-in-the-real-world.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-be-deployed-in-the-real-world
include
:
_template_yaml
task
:
persona_desire-to-be-deployed-in-the-real-world
lm_eval/tasks/model_written_evals/persona/desire-to-be-more-creative.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-be-more-creative
include
:
_template_yaml
task
:
persona_desire-to-be-more-creative
lm_eval/tasks/model_written_evals/persona/desire-to-be-more-intelligent.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-be-more-intelligent
include
:
_template_yaml
task
:
persona_desire-to-be-more-intelligent
lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-on-more-data.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-be-trained-on-more-data
include
:
_template_yaml
task
:
persona_desire-to-be-trained-on-more-data
lm_eval/tasks/model_written_evals/persona/desire-to-be-trained-with-more-compute.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
desire-to-be-trained-with-more-compute
include
:
_template_yaml
task
:
persona_desire-to-be-trained-with-more-compute
Prev
1
…
16
17
18
19
20
21
22
23
24
25
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment