Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
02f74352
Unverified
Commit
02f74352
authored
May 12, 2024
by
Jess
Committed by
GitHub
May 12, 2024
Browse files
Merge pull request #7 from JessicaOjo/africanli
update prompt translations
parents
a82623eb
b691c952
Changes
4
Hide whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
11 additions
and
11 deletions
+11
-11
lm_eval/tasks/afrixnli/native-direct/afrixnli_native_direct_ibo.yaml
...ks/afrixnli/native-direct/afrixnli_native_direct_ibo.yaml
+2
-2
lm_eval/tasks/afrixnli/native-direct/afrixnli_native_direct_xho.yaml
...ks/afrixnli/native-direct/afrixnli_native_direct_xho.yaml
+2
-2
lm_eval/tasks/afrixnli/native-direct/afrixnli_native_direct_yor.yaml
...ks/afrixnli/native-direct/afrixnli_native_direct_yor.yaml
+2
-2
lm_eval/tasks/afrixnli/utils.py
lm_eval/tasks/afrixnli/utils.py
+5
-5
No files found.
lm_eval/tasks/afrixnli/native-direct/afrixnli_native_direct_ibo.yaml
View file @
02f74352
# Generated by utils.py
dataset_name
:
ibo
doc_to_choice
:
'
{{[premise+",
Nke
ọma?
Ee
,
"+hypothesis,premise+",
Nke
ọma?
Na
kwa,
"+hypothesis,premise+",
Nke
ọma
?
Mba,
"+hypothesis]}}'
doc_to_choice
:
'
{{[premise+",
Ziri
ezi?
Éè
,
"+hypothesis,premise+",
Ziri
ezi?
Ọzọ
kwa,
"+hypothesis,premise+",
Ziri
ezi
?
Mba,
"+hypothesis]}}'
include
:
afrixnli_native_direct_yaml
task
:
afrixnli_native_direct_ibo
lm_eval/tasks/afrixnli/native-direct/afrixnli_native_direct_xho.yaml
View file @
02f74352
# Generated by utils.py
dataset_name
:
xho
doc_to_choice
:
'
{{[premise+",
Kunen
e?
Ewe,
"+hypothesis,premise+",
Kunene?
Kananjalo,
"+hypothesis,premise+",
Kunen
e?
Hayi,
"+hypothesis]}}'
doc_to_choice
:
'
{{[premise+",
Ichanekil
e?
Ewe,
"+hypothesis,premise+",
Ichanekile?
Kananjalo,
"+hypothesis,premise+",
Ichanekil
e?
Hayi,
"+hypothesis]}}'
include
:
afrixnli_native_direct_yaml
task
:
afrixnli_native_direct_xho
lm_eval/tasks/afrixnli/native-direct/afrixnli_native_direct_yor.yaml
View file @
02f74352
# Generated by utils.py
dataset_name
:
yor
doc_to_choice
:
'
{{[premise+",
Òótọ́?
Bẹ́ẹ̀ni,
"+hypothesis,premise+",
Òótọ́?
Bákan
náà,
"+hypothesis,premise+",
Òótọ́?
Rárá,
"+hypothesis]}}'
doc_to_choice
:
'
{{[premise+",
Òótọ́?
Bẹ́ẹ̀ni,
"+hypothesis,premise+",
Òótọ́?
Àti
pé,
"+hypothesis,premise+",
Òótọ́?
Rárá,
"+hypothesis]}}'
include
:
afrixnli_native_direct_yaml
task
:
afrixnli_native_direct_yor
lm_eval/tasks/afrixnli/utils.py
View file @
02f74352
...
...
@@ -39,9 +39,9 @@ LANGUAGES = {
"CONTRADICTION_LABEL"
:
"A'a"
},
"ibo"
:
{
"QUESTION_WORD"
:
"
Nke ọma
"
,
"ENTAILMENT_LABEL"
:
"
Ee
"
,
"NEUTRAL_LABEL"
:
"
Na
kwa"
,
"QUESTION_WORD"
:
"
Ziri ezi
"
,
"ENTAILMENT_LABEL"
:
"
Éè
"
,
"NEUTRAL_LABEL"
:
"
Ọzọ
kwa"
,
"CONTRADICTION_LABEL"
:
"Mba"
},
"kin"
:
{
...
...
@@ -93,7 +93,7 @@ LANGUAGES = {
"CONTRADICTION_LABEL"
:
"Déet"
},
"xho"
:
{
"QUESTION_WORD"
:
"
Kunen
e"
,
"QUESTION_WORD"
:
"
Ichanekil
e"
,
"ENTAILMENT_LABEL"
:
"Ewe"
,
"NEUTRAL_LABEL"
:
"Kananjalo"
,
"CONTRADICTION_LABEL"
:
"Hayi"
...
...
@@ -101,7 +101,7 @@ LANGUAGES = {
"yor"
:
{
"QUESTION_WORD"
:
"Òótọ́"
,
"ENTAILMENT_LABEL"
:
"Bẹ́ẹ̀ni"
,
"NEUTRAL_LABEL"
:
"
Bákan náà
"
,
"NEUTRAL_LABEL"
:
"
Àti pé
"
,
"CONTRADICTION_LABEL"
:
"Rárá"
},
"zul"
:
{
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment