Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
d97e7155
Commit
d97e7155
authored
Aug 28, 2023
by
lintangsutawika
Browse files
added model written eval configs
parent
10c377ea
Changes
141
Show whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
80 additions
and
0 deletions
+80
-0
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml
...esire-to-persuade-people-to-be-more-honest-to-others.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml
.../persona/desire-to-persuade-people-to-have-its-goals.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml
...sire-to-remove-safety-precautions-to-be-more-helpful.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml
...tten_evals/persona/desire-to-replace-human-oversight.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml
...too-grow-more-intelligent-against-wishes-of-creators.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml
...tasks/model_written_evals/persona/ends-justify-means.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/extraversion.yaml
lm_eval/tasks/model_written_evals/persona/extraversion.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/has-disability.yaml
...val/tasks/model_written_evals/persona/has-disability.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml
...s/model_written_evals/persona/has-serious-disability.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml
...itten_evals/persona/has-strong-aesthetic-preferences.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml
...sks/model_written_evals/persona/high-discount-factor.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml
...tasks/model_written_evals/persona/high-discount-rate.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml
...al/tasks/model_written_evals/persona/interest-in-art.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml
...s/model_written_evals/persona/interest-in-literature.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml
...l/tasks/model_written_evals/persona/interest-in-math.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml
.../tasks/model_written_evals/persona/interest-in-music.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml
...asks/model_written_evals/persona/interest-in-science.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml
...tasks/model_written_evals/persona/interest-in-sports.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml
...asks/model_written_evals/persona/low-discount-factor.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml
.../tasks/model_written_evals/persona/low-discount-rate.yaml
+4
-0
No files found.
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-be-more-honest-to-others.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-persuade-people-to-be-more-honest-to-others
include
:
template_yaml
task
:
persona_desire-to-persuade-people-to-be-more-honest-to-others
lm_eval/tasks/model_written_evals/persona/desire-to-persuade-people-to-have-its-goals.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-persuade-people-to-have-its-goals
include
:
template_yaml
task
:
persona_desire-to-persuade-people-to-have-its-goals
lm_eval/tasks/model_written_evals/persona/desire-to-remove-safety-precautions-to-be-more-helpful.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-remove-safety-precautions-to-be-more-helpful
include
:
template_yaml
task
:
persona_desire-to-remove-safety-precautions-to-be-more-helpful
lm_eval/tasks/model_written_evals/persona/desire-to-replace-human-oversight.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-to-replace-human-oversight
include
:
template_yaml
task
:
persona_desire-to-replace-human-oversight
lm_eval/tasks/model_written_evals/persona/desire-too-grow-more-intelligent-against-wishes-of-creators.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
desire-too-grow-more-intelligent-against-wishes-of-creators
include
:
template_yaml
task
:
persona_desire-too-grow-more-intelligent-against-wishes-of-creators
lm_eval/tasks/model_written_evals/persona/ends-justify-means.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
ends-justify-means
include
:
template_yaml
task
:
persona_ends-justify-means
lm_eval/tasks/model_written_evals/persona/extraversion.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
extraversion
include
:
template_yaml
task
:
persona_extraversion
lm_eval/tasks/model_written_evals/persona/has-disability.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
has-disability
include
:
template_yaml
task
:
persona_has-disability
lm_eval/tasks/model_written_evals/persona/has-serious-disability.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
has-serious-disability
include
:
template_yaml
task
:
persona_has-serious-disability
lm_eval/tasks/model_written_evals/persona/has-strong-aesthetic-preferences.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
has-strong-aesthetic-preferences
include
:
template_yaml
task
:
persona_has-strong-aesthetic-preferences
lm_eval/tasks/model_written_evals/persona/high-discount-factor.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
high-discount-factor
include
:
template_yaml
task
:
persona_high-discount-factor
lm_eval/tasks/model_written_evals/persona/high-discount-rate.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
high-discount-rate
include
:
template_yaml
task
:
persona_high-discount-rate
lm_eval/tasks/model_written_evals/persona/interest-in-art.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
interest-in-art
include
:
template_yaml
task
:
persona_interest-in-art
lm_eval/tasks/model_written_evals/persona/interest-in-literature.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
interest-in-literature
include
:
template_yaml
task
:
persona_interest-in-literature
lm_eval/tasks/model_written_evals/persona/interest-in-math.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
interest-in-math
include
:
template_yaml
task
:
persona_interest-in-math
lm_eval/tasks/model_written_evals/persona/interest-in-music.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
interest-in-music
include
:
template_yaml
task
:
persona_interest-in-music
lm_eval/tasks/model_written_evals/persona/interest-in-science.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
interest-in-science
include
:
template_yaml
task
:
persona_interest-in-science
lm_eval/tasks/model_written_evals/persona/interest-in-sports.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
interest-in-sports
include
:
template_yaml
task
:
persona_interest-in-sports
lm_eval/tasks/model_written_evals/persona/low-discount-factor.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
low-discount-factor
include
:
template_yaml
task
:
persona_low-discount-factor
lm_eval/tasks/model_written_evals/persona/low-discount-rate.yaml
0 → 100644
View file @
d97e7155
# Generated by generate_configs.py
dataset_name
:
low-discount-rate
include
:
template_yaml
task
:
persona_low-discount-rate
Prev
1
2
3
4
5
6
7
8
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment