Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
21fb0db7
Commit
21fb0db7
authored
May 10, 2024
by
JessicaOjo
Browse files
fix bash script
parent
6ca56eac
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
10 additions
and
12 deletions
+10
-12
lm_eval/tasks/afrimgsm/direct.sh
lm_eval/tasks/afrimgsm/direct.sh
+10
-12
No files found.
lm_eval/tasks/afrimgsm/direct.sh
View file @
21fb0db7
...
@@ -15,22 +15,20 @@ models=(
...
@@ -15,22 +15,20 @@ models=(
"RWKV/v5-EagleX-v2-7B-HF"
"RWKV/v5-EagleX-v2-7B-HF"
"RWKV/rwkv-6-world-7b"
"RWKV/rwkv-6-world-7b"
)
)
task
=
afrimgsm_direct_amh,afrimgsm_direct_ibo,afrimgsm_direct_fra,afrimgsm_direct_sna,afrimgsm_direct_lin,afrimgsm_direct_wol,afrimgsm_direct_ewe,afrimgsm_direct_lug,afrimgsm_direct_xho,afrimgsm_direct_kin,afrimgsm_direct_twi,afrimgsm_direct_zul,afrimgsm_direct_orm,afrimgsm_direct_yor,afrimgsm_direct_hau,afrimgsm_direct_sot,afrimgsm_direct_swa
for
model
in
"
${
models
[@]
}
"
for
model
in
"
${
models
[@]
}
"
do
do
echo
"Evaluating model:
$model
"
echo
"Evaluating model:
$model
"
for
task
in
afrimgsm_direct_eng afrimgsm_direct_amh afrimgsm_direct_ibo afrimgsm_direct_fra afrimgsm_direct_sna afrimgsm_direct_lin afrimgsm_direct_wol afrimgsm_direct_ewe afrimgsm_direct_lug afrimgsm_direct_xho afrimgsm_direct_kin afrimgsm_direct_twi afrimgsm_direct_zul afrimgsm_direct_orm afrimgsm_direct_yor afrimgsm_direct_hau afrimgsm_direct_sot afrimgsm_direct_swa
export
OUTPUT_DIR
=
results/
${
model
##*/
}
do
export
OUTPUT_DIR
=
results/
${
model
##*/
}
/
${
task
}
mkdir
-p
"
$OUTPUT_DIR
"
mkdir
-p
"
$OUTPUT_DIR
"
lm_eval
--model
hf
\
lm_eval
--model
hf
\
--model_args
"pretrained=
${
model
}
"
\
--model_args
"pretrained=
${
model
}
"
\
--tasks
task
\
--tasks
$
task
\
--device
cuda:0
\
--device
cuda:0
\
--batch_size
16
\
--batch_size
16
\
--num_fewshot
0
\
--num_fewshot
0
\
--verbosity
DEBUG
--verbosity
DEBUG
done
done
done
\ No newline at end of file
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment