Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
3c0df6e9
"research/slim/datasets/process_bounding_boxes.py" did not exist on "2335c9fc92ce1ed6187a47a89ff42918d305f424"
Commit
3c0df6e9
authored
May 23, 2024
by
Yen-Ting Lin
Browse files
Add new models and update parameters in run_all.sh
parent
6ccfb952
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
1 deletion
+5
-1
run_all.sh
run_all.sh
+5
-1
No files found.
run_all.sh
View file @
3c0df6e9
...
...
@@ -2,9 +2,13 @@
# Define the models to run
declare
-a
models
=(
"yentinglin/Llama-3-Taiwan-70B-Instruct-rc3"
"yentinglin/Llama-3-Taiwan-70B-Instruct-rc2"
"yentinglin/Llama-3-Taiwan-70B-Instruct-rc1"
"yentinglin/Llama-3-Taiwan-70B-Instruct"
"yentinglin/Taiwan-Llama-3-70B-Cooldown"
"yentinglin/Taiwan-Llama-3-70B"
"yentinglin/Llama-3-Taiwan-8B-Instruct-rc1"
"yentinglin/Taiwan-Llama-3-8B-Instruct"
"yentinglin/Taiwan-Llama-3-8B-Cooldown"
"yentinglin/Taiwan-Llama-3-8B"
...
...
@@ -31,7 +35,7 @@ declare -a models=(
SLURM_SCRIPT
=
"harness_eval.slurm"
# Parameters for the script
PARAMS
=
"tmlu,twllm_eval,tw_legal,ccp,pega,tmmluplus"
PARAMS
=
"tmlu,twllm_eval,tw_legal,ccp,pega,tmmluplus
,mmlu,pega_mmlu
"
# Loop through each model and submit a job
for
model
in
"
${
models
[@]
}
"
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment