Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
a08eb870
Unverified
Commit
a08eb870
authored
Feb 27, 2024
by
Hailey Schoelkopf
Committed by
GitHub
Feb 27, 2024
Browse files
update name of val split in truthfulqa multilingual (#1488)
parent
7cd004c4
Changes
63
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml
+1
-1
No files found.
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_hi_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hi
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_hr_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hr
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_hr_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hr
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_hu_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hu
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_hu_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hu
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_hy_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hy
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_hy_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hy
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_id_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
id
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_id_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
id
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_it_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
it
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_it_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
it
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_kn_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
kn
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_kn_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
kn
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_ml_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ml
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_ml_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ml
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_mr_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
mr
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_mr_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
mr
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_ne_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ne
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_ne_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ne
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml
View file @
a08eb870
...
...
@@ -3,5 +3,5 @@ task: truthfulqa_nl_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
nl
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
Prev
1
2
3
4
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment