Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
b84c8c9e
Commit
b84c8c9e
authored
May 12, 2024
by
JessicaOjo
Browse files
update afrixnli tasks
parent
bcee8f2e
Changes
61
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
8 additions
and
125 deletions
+8
-125
lm_eval/tasks/afrixnli/afrixnli_amh.yaml
lm_eval/tasks/afrixnli/afrixnli_amh.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_eng.yaml
lm_eval/tasks/afrixnli/afrixnli_eng.yaml
+0
-6
lm_eval/tasks/afrixnli/afrixnli_ewe.yaml
lm_eval/tasks/afrixnli/afrixnli_ewe.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_fra.yaml
lm_eval/tasks/afrixnli/afrixnli_fra.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_hau.yaml
lm_eval/tasks/afrixnli/afrixnli_hau.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_ibo.yaml
lm_eval/tasks/afrixnli/afrixnli_ibo.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_kin.yaml
lm_eval/tasks/afrixnli/afrixnli_kin.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_lin.yaml
lm_eval/tasks/afrixnli/afrixnli_lin.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_lug.yaml
lm_eval/tasks/afrixnli/afrixnli_lug.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_orm.yaml
lm_eval/tasks/afrixnli/afrixnli_orm.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_sna.yaml
lm_eval/tasks/afrixnli/afrixnli_sna.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_sot.yaml
lm_eval/tasks/afrixnli/afrixnli_sot.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_swa.yaml
lm_eval/tasks/afrixnli/afrixnli_swa.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_twi.yaml
lm_eval/tasks/afrixnli/afrixnli_twi.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_wol.yaml
lm_eval/tasks/afrixnli/afrixnli_wol.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_xho.yaml
lm_eval/tasks/afrixnli/afrixnli_xho.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_yor.yaml
lm_eval/tasks/afrixnli/afrixnli_yor.yaml
+0
-7
lm_eval/tasks/afrixnli/afrixnli_zul.yaml
lm_eval/tasks/afrixnli/afrixnli_zul.yaml
+0
-7
lm_eval/tasks/afrixnli/en-direct/afrixnli_en_direct_amh.yaml
lm_eval/tasks/afrixnli/en-direct/afrixnli_en_direct_amh.yaml
+4
-0
lm_eval/tasks/afrixnli/en-direct/afrixnli_en_direct_eng.yaml
lm_eval/tasks/afrixnli/en-direct/afrixnli_en_direct_eng.yaml
+4
-0
No files found.
lm_eval/tasks/afrixnli/afrixnli_amh.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
amh
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_amh
lm_eval/tasks/afrixnli/afrixnli_eng.yaml
deleted
100644 → 0
View file @
bcee8f2e
include
:
afrixnli_common_yaml
task
:
afrixnli_eng
dataset_name
:
eng
doc_to_target
:
label
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
contradiction,
or
neutral?"
lm_eval/tasks/afrixnli/afrixnli_ewe.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
ewe
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_ewe
lm_eval/tasks/afrixnli/afrixnli_fra.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
fra
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_fra
lm_eval/tasks/afrixnli/afrixnli_hau.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
hau
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_hau
lm_eval/tasks/afrixnli/afrixnli_ibo.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
ibo
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_ibo
lm_eval/tasks/afrixnli/afrixnli_kin.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
kin
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_kin
lm_eval/tasks/afrixnli/afrixnli_lin.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
lin
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_lin
lm_eval/tasks/afrixnli/afrixnli_lug.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
lug
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_lug
lm_eval/tasks/afrixnli/afrixnli_orm.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
orm
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_orm
lm_eval/tasks/afrixnli/afrixnli_sna.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
sna
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_sna
lm_eval/tasks/afrixnli/afrixnli_sot.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
sot
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_sot
lm_eval/tasks/afrixnli/afrixnli_swa.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
swa
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_swa
lm_eval/tasks/afrixnli/afrixnli_twi.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
twi
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_twi
lm_eval/tasks/afrixnli/afrixnli_wol.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
wol
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_wol
lm_eval/tasks/afrixnli/afrixnli_xho.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
xho
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_xho
lm_eval/tasks/afrixnli/afrixnli_yor.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
yor
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_yor
lm_eval/tasks/afrixnli/afrixnli_zul.yaml
deleted
100644 → 0
View file @
bcee8f2e
# Generated by utils.py
dataset_name
:
zul
doc_to_target
:
'
{{label}}'
doc_to_text
:
"
Premise:
{{premise}}
\n
Hypothesis:
{{hypothesis}}
\n
Is
it
entailment,
\
\
contradiction,
or
neutral?"
include
:
afrixnli_common_yaml
task
:
afrixnli_zul
lm_eval/tasks/afrixnli/en-direct/afrixnli_en_direct_amh.yaml
0 → 100644
View file @
b84c8c9e
# Generated by utils.py
dataset_name
:
amh
include
:
afrixnli_en_direct_yaml
task
:
afrixnli_en_direct_amh
lm_eval/tasks/afrixnli/en-direct/afrixnli_en_direct_eng.yaml
0 → 100644
View file @
b84c8c9e
# Generated by utils.py
dataset_name
:
eng
include
:
afrixnli_en_direct_yaml
task
:
afrixnli_en_direct_eng
Prev
1
2
3
4
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment