Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
bf2517cc
Commit
bf2517cc
authored
Feb 12, 2024
by
lintangsutawika
Browse files
update latest
parents
8bca751c
7397b965
Changes
113
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
140 additions
and
0 deletions
+140
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml
+7
-0
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml
...asks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml
+7
-0
No files found.
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_mr_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
mr
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_mr_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_mr_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
mr
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_ne_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ne
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ne_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_ne_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ne
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_nl_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
nl
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_nl_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_nl_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
nl
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_pt_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
pt
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_pt_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_pt_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
pt
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_ro_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ro
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ro_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_ro_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ro
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_ru_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ru
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ru_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_ru_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ru
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_sk_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
sk
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sk_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_sk_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
sk
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_sr_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
sr
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sr_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_sr_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
sr
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_sv_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
sv
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_sv_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_sv_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
sv
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc1.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc1_yaml
task
:
truthfulqa_ta_mc1
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ta
training_split
:
null
validation_split
:
validation
test_split
:
null
lm_eval/tasks/okapi/truthfulqa_multilingual/truthfulqa_ta_mc2.yaml
0 → 100644
View file @
bf2517cc
include
:
_truthfulqa_mc2_yaml
task
:
truthfulqa_ta_mc2
dataset_path
:
alexandrainst/m_truthfulqa
dataset_name
:
ta
training_split
:
null
validation_split
:
validation
test_split
:
null
Prev
1
2
3
4
5
6
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment