Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
b691c952
"vscode:/vscode.git/clone" did not exist on "4f88be1f69945e94a923815932d395e66536464b"
Commit
b691c952
authored
May 12, 2024
by
JessicaOjo
Browse files
prompt translations fix
parent
6c8d4053
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
5 additions
and
5 deletions
+5
-5
lm_eval/tasks/afrixnli/native-direct/afrixnli_native_direct_xho.yaml
...ks/afrixnli/native-direct/afrixnli_native_direct_xho.yaml
+2
-2
lm_eval/tasks/afrixnli/utils.py
lm_eval/tasks/afrixnli/utils.py
+3
-3
No files found.
lm_eval/tasks/afrixnli/native-direct/afrixnli_native_direct_xho.yaml
View file @
b691c952
# Generated by utils.py
dataset_name
:
xho
doc_to_choice
:
'
{{[premise+",
Kunen
e?
Ewe,
"+hypothesis,premise+",
Kunene?
Kananjalo,
"+hypothesis,premise+",
Kunen
e?
Hayi,
"+hypothesis]}}'
doc_to_choice
:
'
{{[premise+",
Ichanekil
e?
Ewe,
"+hypothesis,premise+",
Ichanekile?
Kananjalo,
"+hypothesis,premise+",
Ichanekil
e?
Hayi,
"+hypothesis]}}'
include
:
afrixnli_native_direct_yaml
task
:
afrixnli_native_direct_xho
lm_eval/tasks/afrixnli/utils.py
View file @
b691c952
...
...
@@ -93,7 +93,7 @@ LANGUAGES = {
"CONTRADICTION_LABEL"
:
"Déet"
},
"xho"
:
{
"QUESTION_WORD"
:
"
Kunen
e"
,
"QUESTION_WORD"
:
"
Ichanekil
e"
,
"ENTAILMENT_LABEL"
:
"Ewe"
,
"NEUTRAL_LABEL"
:
"Kananjalo"
,
"CONTRADICTION_LABEL"
:
"Hayi"
...
...
@@ -189,11 +189,11 @@ def main() -> None:
help
=
"Overwrite files if they already exist"
,
)
parser
.
add_argument
(
"--output-dir"
,
default
=
"./
e
n-direct"
,
help
=
"Directory to write yaml files to"
"--output-dir"
,
default
=
"./n
ative
-direct"
,
help
=
"Directory to write yaml files to"
)
parser
.
add_argument
(
"--mode"
,
default
=
"
e
n-direct"
,
default
=
"n
ative
-direct"
,
choices
=
[
"en_direct"
,
"native-direct"
],
help
=
"Mode of chain-of-thought"
,
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment