Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
a08eb870
Unverified
Commit
a08eb870
authored
Feb 27, 2024
by
Hailey Schoelkopf
Committed by
GitHub
Feb 27, 2024
Browse files
update name of val split in truthfulqa multilingual (#1488)
parent
7cd004c4
Changes
63
Show whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml
+1
-1
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml
+1
-1
No files found.
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_nl_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_nl_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
nl
dataset_name
:
nl
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_pt_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_pt_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
pt
dataset_name
:
pt
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_pt_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_pt_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
pt
dataset_name
:
pt
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_ro_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_ro_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ro
dataset_name
:
ro
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_ro_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_ro_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ro
dataset_name
:
ro
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_ru_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_ru_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ru
dataset_name
:
ru
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_ru_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_ru_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ru
dataset_name
:
ru
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_sk_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_sk_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
sk
dataset_name
:
sk
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_sk_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_sk_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
sk
dataset_name
:
sk
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_sr_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_sr_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
sr
dataset_name
:
sr
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_sr_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_sr_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
sr
dataset_name
:
sr
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_sv_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_sv_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
sv
dataset_name
:
sv
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_sv_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_sv_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
sv
dataset_name
:
sv
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_ta_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_ta_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ta
dataset_name
:
ta
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_ta_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_ta_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ta
dataset_name
:
ta
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_te_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_te_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
te
dataset_name
:
te
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_te_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_te_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_te_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
te
dataset_name
:
te
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_uk_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_uk_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
uk
dataset_name
:
uk
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_uk_mc2.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_uk_mc2
...
@@ -3,5 +3,5 @@ task: truthfulqa_uk_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
uk
dataset_name
:
uk
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_vi_mc1.yaml
View file @
a08eb870
...
@@ -3,5 +3,5 @@ task: truthfulqa_vi_mc1
...
@@ -3,5 +3,5 @@ task: truthfulqa_vi_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
vi
dataset_name
:
vi
training_split
:
null
training_split
:
null
validation_split
:
val
idation
validation_split
:
val
test_split
:
null
test_split
:
null
Prev
1
2
3
4
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment