Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
86edeffa
"...lm-evaluation-harness.git" did not exist on "478d96cdacbad1aa59087ec61b80f0d988fe62a2"
Unverified
Commit
86edeffa
authored
Aug 20, 2024
by
Uminosachi
Committed by
GitHub
Aug 19, 2024
Browse files
Update yaml to adapt to belebele dataset changes (#2216)
parent
f81b62bf
Changes
123
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
100 additions
and
80 deletions
+100
-80
lm_eval/tasks/belebele/belebele_swh_Latn.yaml
lm_eval/tasks/belebele/belebele_swh_Latn.yaml
+5
-4
lm_eval/tasks/belebele/belebele_tam_Taml.yaml
lm_eval/tasks/belebele/belebele_tam_Taml.yaml
+5
-4
lm_eval/tasks/belebele/belebele_tel_Telu.yaml
lm_eval/tasks/belebele/belebele_tel_Telu.yaml
+5
-4
lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml
lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml
+5
-4
lm_eval/tasks/belebele/belebele_tgl_Latn.yaml
lm_eval/tasks/belebele/belebele_tgl_Latn.yaml
+5
-4
lm_eval/tasks/belebele/belebele_tha_Thai.yaml
lm_eval/tasks/belebele/belebele_tha_Thai.yaml
+5
-4
lm_eval/tasks/belebele/belebele_tir_Ethi.yaml
lm_eval/tasks/belebele/belebele_tir_Ethi.yaml
+5
-4
lm_eval/tasks/belebele/belebele_tsn_Latn.yaml
lm_eval/tasks/belebele/belebele_tsn_Latn.yaml
+5
-4
lm_eval/tasks/belebele/belebele_tso_Latn.yaml
lm_eval/tasks/belebele/belebele_tso_Latn.yaml
+5
-4
lm_eval/tasks/belebele/belebele_tur_Latn.yaml
lm_eval/tasks/belebele/belebele_tur_Latn.yaml
+5
-4
lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml
lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml
+5
-4
lm_eval/tasks/belebele/belebele_urd_Arab.yaml
lm_eval/tasks/belebele/belebele_urd_Arab.yaml
+5
-4
lm_eval/tasks/belebele/belebele_urd_Latn.yaml
lm_eval/tasks/belebele/belebele_urd_Latn.yaml
+5
-4
lm_eval/tasks/belebele/belebele_uzn_Latn.yaml
lm_eval/tasks/belebele/belebele_uzn_Latn.yaml
+5
-4
lm_eval/tasks/belebele/belebele_vie_Latn.yaml
lm_eval/tasks/belebele/belebele_vie_Latn.yaml
+5
-4
lm_eval/tasks/belebele/belebele_war_Latn.yaml
lm_eval/tasks/belebele/belebele_war_Latn.yaml
+5
-4
lm_eval/tasks/belebele/belebele_wol_Latn.yaml
lm_eval/tasks/belebele/belebele_wol_Latn.yaml
+5
-4
lm_eval/tasks/belebele/belebele_xho_Latn.yaml
lm_eval/tasks/belebele/belebele_xho_Latn.yaml
+5
-4
lm_eval/tasks/belebele/belebele_yor_Latn.yaml
lm_eval/tasks/belebele/belebele_yor_Latn.yaml
+5
-4
lm_eval/tasks/belebele/belebele_zho_Hans.yaml
lm_eval/tasks/belebele/belebele_zho_Hans.yaml
+5
-4
No files found.
lm_eval/tasks/belebele/belebele_swh_Latn.yaml
View file @
86edeffa
"
fewshot_split"
:
"
swh_Latn"
dataset_name
:
swh_Latn
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_swh_Latn"
include
:
_default_template_yaml
"
test_split"
:
"
swh_Latn"
task
:
belebele_swh_Latn
test_split
:
test
lm_eval/tasks/belebele/belebele_tam_Taml.yaml
View file @
86edeffa
"
fewshot_split"
:
"
tam_Taml"
dataset_name
:
tam_Taml
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_tam_Taml"
include
:
_default_template_yaml
"
test_split"
:
"
tam_Taml"
task
:
belebele_tam_Taml
test_split
:
test
lm_eval/tasks/belebele/belebele_tel_Telu.yaml
View file @
86edeffa
"
fewshot_split"
:
"
tel_Telu"
dataset_name
:
tel_Telu
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_tel_Telu"
include
:
_default_template_yaml
"
test_split"
:
"
tel_Telu"
task
:
belebele_tel_Telu
test_split
:
test
lm_eval/tasks/belebele/belebele_tgk_Cyrl.yaml
View file @
86edeffa
"
fewshot_split"
:
"
tgk_Cyrl"
dataset_name
:
tgk_Cyrl
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_tgk_Cyrl"
include
:
_default_template_yaml
"
test_split"
:
"
tgk_Cyrl"
task
:
belebele_tgk_Cyrl
test_split
:
test
lm_eval/tasks/belebele/belebele_tgl_Latn.yaml
View file @
86edeffa
"
fewshot_split"
:
"
tgl_Latn"
dataset_name
:
tgl_Latn
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_tgl_Latn"
include
:
_default_template_yaml
"
test_split"
:
"
tgl_Latn"
task
:
belebele_tgl_Latn
test_split
:
test
lm_eval/tasks/belebele/belebele_tha_Thai.yaml
View file @
86edeffa
"
fewshot_split"
:
"
tha_Thai"
dataset_name
:
tha_Thai
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_tha_Thai"
include
:
_default_template_yaml
"
test_split"
:
"
tha_Thai"
task
:
belebele_tha_Thai
test_split
:
test
lm_eval/tasks/belebele/belebele_tir_Ethi.yaml
View file @
86edeffa
"
fewshot_split"
:
"
tir_Ethi"
dataset_name
:
tir_Ethi
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_tir_Ethi"
include
:
_default_template_yaml
"
test_split"
:
"
tir_Ethi"
task
:
belebele_tir_Ethi
test_split
:
test
lm_eval/tasks/belebele/belebele_tsn_Latn.yaml
View file @
86edeffa
"
fewshot_split"
:
"
tsn_Latn"
dataset_name
:
tsn_Latn
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_tsn_Latn"
include
:
_default_template_yaml
"
test_split"
:
"
tsn_Latn"
task
:
belebele_tsn_Latn
test_split
:
test
lm_eval/tasks/belebele/belebele_tso_Latn.yaml
View file @
86edeffa
"
fewshot_split"
:
"
tso_Latn"
dataset_name
:
tso_Latn
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_tso_Latn"
include
:
_default_template_yaml
"
test_split"
:
"
tso_Latn"
task
:
belebele_tso_Latn
test_split
:
test
lm_eval/tasks/belebele/belebele_tur_Latn.yaml
View file @
86edeffa
"
fewshot_split"
:
"
tur_Latn"
dataset_name
:
tur_Latn
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_tur_Latn"
include
:
_default_template_yaml
"
test_split"
:
"
tur_Latn"
task
:
belebele_tur_Latn
test_split
:
test
lm_eval/tasks/belebele/belebele_ukr_Cyrl.yaml
View file @
86edeffa
"
fewshot_split"
:
"
ukr_Cyrl"
dataset_name
:
ukr_Cyrl
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_ukr_Cyrl"
include
:
_default_template_yaml
"
test_split"
:
"
ukr_Cyrl"
task
:
belebele_ukr_Cyrl
test_split
:
test
lm_eval/tasks/belebele/belebele_urd_Arab.yaml
View file @
86edeffa
"
fewshot_split"
:
"
urd_Arab"
dataset_name
:
urd_Arab
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_urd_Arab"
include
:
_default_template_yaml
"
test_split"
:
"
urd_Arab"
task
:
belebele_urd_Arab
test_split
:
test
lm_eval/tasks/belebele/belebele_urd_Latn.yaml
View file @
86edeffa
"
fewshot_split"
:
"
urd_Latn"
dataset_name
:
urd_Latn
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_urd_Latn"
include
:
_default_template_yaml
"
test_split"
:
"
urd_Latn"
task
:
belebele_urd_Latn
test_split
:
test
lm_eval/tasks/belebele/belebele_uzn_Latn.yaml
View file @
86edeffa
"
fewshot_split"
:
"
uzn_Latn"
dataset_name
:
uzn_Latn
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_uzn_Latn"
include
:
_default_template_yaml
"
test_split"
:
"
uzn_Latn"
task
:
belebele_uzn_Latn
test_split
:
test
lm_eval/tasks/belebele/belebele_vie_Latn.yaml
View file @
86edeffa
"
fewshot_split"
:
"
vie_Latn"
dataset_name
:
vie_Latn
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_vie_Latn"
include
:
_default_template_yaml
"
test_split"
:
"
vie_Latn"
task
:
belebele_vie_Latn
test_split
:
test
lm_eval/tasks/belebele/belebele_war_Latn.yaml
View file @
86edeffa
"
fewshot_split"
:
"
war_Latn"
dataset_name
:
war_Latn
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_war_Latn"
include
:
_default_template_yaml
"
test_split"
:
"
war_Latn"
task
:
belebele_war_Latn
test_split
:
test
lm_eval/tasks/belebele/belebele_wol_Latn.yaml
View file @
86edeffa
"
fewshot_split"
:
"
wol_Latn"
dataset_name
:
wol_Latn
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_wol_Latn"
include
:
_default_template_yaml
"
test_split"
:
"
wol_Latn"
task
:
belebele_wol_Latn
test_split
:
test
lm_eval/tasks/belebele/belebele_xho_Latn.yaml
View file @
86edeffa
"
fewshot_split"
:
"
xho_Latn"
dataset_name
:
xho_Latn
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_xho_Latn"
include
:
_default_template_yaml
"
test_split"
:
"
xho_Latn"
task
:
belebele_xho_Latn
test_split
:
test
lm_eval/tasks/belebele/belebele_yor_Latn.yaml
View file @
86edeffa
"
fewshot_split"
:
"
yor_Latn"
dataset_name
:
yor_Latn
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_yor_Latn"
include
:
_default_template_yaml
"
test_split"
:
"
yor_Latn"
task
:
belebele_yor_Latn
test_split
:
test
lm_eval/tasks/belebele/belebele_zho_Hans.yaml
View file @
86edeffa
"
fewshot_split"
:
"
zho_Hans"
dataset_name
:
zho_Hans
"
include"
:
"
_default_template_yaml"
fewshot_split
:
test
"
task"
:
"
belebele_zho_Hans"
include
:
_default_template_yaml
"
test_split"
:
"
zho_Hans"
task
:
belebele_zho_Hans
test_split
:
test
Prev
1
2
3
4
5
6
7
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment