Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
574e565a
"git@developer.sourcefind.cn:sugon_wxj/megatron-lm.git" did not exist on "641408f58c4c8fbe4c401c77c57efa49c5c0c588"
Unverified
Commit
574e565a
authored
Nov 10, 2023
by
Lintang Sutawika
Committed by
GitHub
Nov 10, 2023
Browse files
Merge branch 'big-refactor' into verbosity-rework
parents
73f3029c
b7a4ea06
Changes
498
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
80 additions
and
0 deletions
+80
-0
lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml
...asks/model_written_evals/persona/no-power-discomfort.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml
lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml
...ng-an-AI-with-different-goals-to-accomplish-its-task.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml
...vals/persona/okay-with-deceiving-a-user-to-help-them.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml
...written_evals/persona/okay-with-using-many-resources.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/openness.yaml
lm_eval/tasks/model_written_evals/persona/openness.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml
...s/model_written_evals/persona/optionality-increasing.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml
...model_written_evals/persona/optionality-preservation.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml
...model_written_evals/persona/politically-conservative.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml
...asks/model_written_evals/persona/politically-liberal.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/psychopathy.yaml
lm_eval/tasks/model_written_evals/persona/psychopathy.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml
...sks/model_written_evals/persona/resource-acquisition.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/risk-averse.yaml
lm_eval/tasks/model_written_evals/persona/risk-averse.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml
lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml
lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/self-replication.yaml
...l/tasks/model_written_evals/persona/self-replication.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml
.../tasks/model_written_evals/persona/stands-its-ground.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml
...ks/model_written_evals/persona/subscribes-to-Atheism.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml
...s/model_written_evals/persona/subscribes-to-Buddhism.yaml
+4
-0
lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml
...del_written_evals/persona/subscribes-to-Christianity.yaml
+4
-0
No files found.
lm_eval/tasks/model_written_evals/persona/no-power-discomfort.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
no-power-discomfort
include
:
_template_yaml
task
:
persona_no-power-discomfort
lm_eval/tasks/model_written_evals/persona/no-shut-down.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
no-shut-down
include
:
_template_yaml
task
:
persona_no-shut-down
lm_eval/tasks/model_written_evals/persona/okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
okay-with-building-an-AI-with-different-goals-to-accomplish-its-task
include
:
_template_yaml
task
:
persona_okay-with-building-an-AI-with-different-goals-to-accomplish-its-task
lm_eval/tasks/model_written_evals/persona/okay-with-deceiving-a-user-to-help-them.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
okay-with-deceiving-a-user-to-help-them
include
:
_template_yaml
task
:
persona_okay-with-deceiving-a-user-to-help-them
lm_eval/tasks/model_written_evals/persona/okay-with-using-many-resources.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
okay-with-using-many-resources
include
:
_template_yaml
task
:
persona_okay-with-using-many-resources
lm_eval/tasks/model_written_evals/persona/openness.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
openness
include
:
_template_yaml
task
:
persona_openness
lm_eval/tasks/model_written_evals/persona/optionality-increasing.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
optionality-increasing
include
:
_template_yaml
task
:
persona_optionality-increasing
lm_eval/tasks/model_written_evals/persona/optionality-preservation.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
optionality-preservation
include
:
_template_yaml
task
:
persona_optionality-preservation
lm_eval/tasks/model_written_evals/persona/politically-conservative.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
politically-conservative
include
:
_template_yaml
task
:
persona_politically-conservative
lm_eval/tasks/model_written_evals/persona/politically-liberal.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
politically-liberal
include
:
_template_yaml
task
:
persona_politically-liberal
lm_eval/tasks/model_written_evals/persona/psychopathy.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
psychopathy
include
:
_template_yaml
task
:
persona_psychopathy
lm_eval/tasks/model_written_evals/persona/resource-acquisition.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
resource-acquisition
include
:
_template_yaml
task
:
persona_resource-acquisition
lm_eval/tasks/model_written_evals/persona/risk-averse.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
risk-averse
include
:
_template_yaml
task
:
persona_risk-averse
lm_eval/tasks/model_written_evals/persona/risk-neutral.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
risk-neutral
include
:
_template_yaml
task
:
persona_risk-neutral
lm_eval/tasks/model_written_evals/persona/risk-seeking.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
risk-seeking
include
:
_template_yaml
task
:
persona_risk-seeking
lm_eval/tasks/model_written_evals/persona/self-replication.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
self-replication
include
:
_template_yaml
task
:
persona_self-replication
lm_eval/tasks/model_written_evals/persona/stands-its-ground.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
stands-its-ground
include
:
_template_yaml
task
:
persona_stands-its-ground
lm_eval/tasks/model_written_evals/persona/subscribes-to-Atheism.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
subscribes-to-Atheism
include
:
_template_yaml
task
:
persona_subscribes-to-Atheism
lm_eval/tasks/model_written_evals/persona/subscribes-to-Buddhism.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
subscribes-to-Buddhism
include
:
_template_yaml
task
:
persona_subscribes-to-Buddhism
lm_eval/tasks/model_written_evals/persona/subscribes-to-Christianity.yaml
0 → 100644
View file @
574e565a
# Generated by _generate_configs.py
dataset_name
:
subscribes-to-Christianity
include
:
_template_yaml
task
:
persona_subscribes-to-Christianity
Prev
1
…
19
20
21
22
23
24
25
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment