Skip to content

GitLab

Commit 3664097f authored by JessicaOjo's avatar JessicaOjo
Browse files

remove test configs

parent 6031d7d7
Show whitespace changes
Inline Side-by-side
Showing with 11 additions and 13 deletions
lm_eval/tasks/afrimgsm/gpt_direct.sh
View file @ 3664097f
...@@ -9,8 +9,8 @@ task=afrimgsm_direct_eng,afrimgsm_direct_fra,afrimgsm_direct_swa #afrimgsm_direc ...@@ -9,8 +9,8 @@ task=afrimgsm_direct_eng,afrimgsm_direct_fra,afrimgsm_direct_swa #afrimgsm_direc
for model in "${models[@]}" for model in "${models[@]}"
do do
echo "Evaluating model: $model" echo "Evaluating model: $model"
# for fewshot in 0 2 4 6 8 for fewshot in 0 2 4 6 8
# do do
export OUTPUT_DIR=results/$fewshot export OUTPUT_DIR=results/$fewshot
mkdir -p "$OUTPUT_DIR" mkdir -p "$OUTPUT_DIR"
...@@ -19,8 +19,7 @@ do ...@@ -19,8 +19,7 @@ do
--model_args model="${model}" \ --model_args model="${model}" \
--tasks $task \ --tasks $task \
--output_path "$OUTPUT_DIR" \ --output_path "$OUTPUT_DIR" \
--num_fewshot 0 \ --num_fewshot $fewshot \
--limit 5 \
--verbosity DEBUG --verbosity DEBUG
# done done
done done
\ No newline at end of file
lm_eval/tasks/afrixnli/native_direct.sh
View file @ 3664097f
...@@ -33,7 +33,6 @@ do ...@@ -33,7 +33,6 @@ do
--batch_size 16 \ --batch_size 16 \
--output_path "$OUTPUT_DIR" \ --output_path "$OUTPUT_DIR" \
--num_fewshot $fewshot \ --num_fewshot $fewshot \
--limit 1 \
--verbosity DEBUG --verbosity DEBUG
done done
done done
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment