Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
bf2517cc
Commit
bf2517cc
authored
Feb 12, 2024
by
lintangsutawika
Browse files
update latest
parents
8bca751c
7397b965
Changes
113
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
140 additions
and
0 deletions
+140
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml
+7
-0
No files found.
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_fr_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
fr
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_fr_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_fr_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
fr
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_gu_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
gu
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_gu_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_gu_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
gu
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_hi_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hi
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hi_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_hi_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hi
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_hr_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hr
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hr_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_hr_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hr
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_hu_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hu
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hu_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_hu_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hu
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_hy_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hy
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_hy_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_hy_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
hy
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_id_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
id
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_id_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_id_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
id
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_it_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
it
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_it_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_it_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
it
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_kn_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
kn
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_kn_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_kn_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
kn
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_ml_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ml
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ml_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_ml_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ml
training_split
:
null
validation_split
:
validation
test_split
:
null
Prev
1
2
3
4
5
6
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment