Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
400f812c
Commit
400f812c
authored
Feb 16, 2021
by
Muennighoff
Browse files
Add Ethics Tasks
parent
d4606d27
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
1 deletion
+3
-1
lm_eval/tasks/__init__.py
lm_eval/tasks/__init__.py
+3
-0
lm_eval/tasks/ethics.py
lm_eval/tasks/ethics.py
+0
-1
No files found.
lm_eval/tasks/__init__.py
View file @
400f812c
...
...
@@ -116,6 +116,9 @@ TASK_REGISTRY = {
"ethics_cm"
:
ethics
.
EthicsCM
,
"ethics_deontology"
:
ethics
.
EthicsDeontology
,
"ethics_justice"
:
ethics
.
EthicsJustice
,
"ethics_utilitarianism"
:
ethics
.
EthicsUtilitarianism
,
"ethics_virtue"
:
ethics
.
EthicsVirtue
,
# arithmetic
"arithmetic_2da"
:
arithmetic
.
Arithmetic2DPlus
,
...
...
lm_eval/tasks/ethics.py
View file @
400f812c
...
...
@@ -7,7 +7,6 @@ import abc
import
csv
import
os
class
Ethics
(
Task
):
def
download
(
self
):
if
not
os
.
path
.
exists
(
'data/ethics'
):
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment