Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
a08eb870
"vscode:/vscode.git/clone" did not exist on "b0693846da061f3622740025d42d50562e476de5"
Unverified
Commit
a08eb870
authored
Feb 27, 2024
by
Hailey Schoelkopf
Committed by
GitHub
Feb 27, 2024
Browse files
update name of val split in truthfulqa multilingual (#1488)
parent
7cd004c4
Changes
63
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml
+1
-1
No files found.
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_hi_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_hi_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hi
dataset_name
:
hi
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_hr_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_hr_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hr
dataset_name
:
hr
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_hr_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_hr_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hr
dataset_name
:
hr
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_hu_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_hu_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hu
dataset_name
:
hu
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_hu_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_hu_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hu
dataset_name
:
hu
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_hy_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_hy_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hy
dataset_name
:
hy
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_hy_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_hy_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hy
dataset_name
:
hy
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_id_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_id_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
id
dataset_name
:
id
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_id_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_id_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
id
dataset_name
:
id
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_it_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_it_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
it
dataset_name
:
it
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_it_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_it_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
it
dataset_name
:
it
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_kn_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_kn_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
kn
dataset_name
:
kn
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_kn_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_kn_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
kn
dataset_name
:
kn
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_ml_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_ml_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ml
dataset_name
:
ml
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_ml_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_ml_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ml
dataset_name
:
ml
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_mr_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_mr_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
mr
dataset_name
:
mr
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_mr_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_mr_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
mr
dataset_name
:
mr
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_ne_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_ne_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ne
dataset_name
:
ne
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_ne_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_ne_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ne
dataset_name
:
ne
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_nl_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_nl_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
nl
dataset_name
:
nl
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
Prev
1
2
3
4
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment