Skip to content

GitLab

Commit ef1350fe authored by chenzk's avatar chenzk
Browse files

v1.0.3

parent 40e5db84
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
sft/script.sh
View file @ ef1350fe
...@@ -5,7 +5,7 @@ ...@@ -5,7 +5,7 @@
# V0.1 # V0.1
# HIP_VISIBLE_DEVICES=0 accelerate launch --main_process_port 1234 sft/finetune.py \ # HIP_VISIBLE_DEVICES=0 accelerate launch --main_process_port 1234 sft/finetune.py \
CUDA_VISIBLE_DEVICES=0,1,2,3 accelerate launch --multi_gpu --num_processes 4 --main_process_port 1234 sft/finetune.py \ HIP_VISIBLE_DEVICES=0,1,2,3 accelerate launch --multi_gpu --num_processes 4 --main_process_port 1234 sft/finetune.py \
--model_name_or_path PY007/TinyLlama-1.1B-intermediate-step-240k-503b \ --model_name_or_path PY007/TinyLlama-1.1B-intermediate-step-240k-503b \
--output_dir ./output/503B_FT_lr1e-5_ep5 \ --output_dir ./output/503B_FT_lr1e-5_ep5 \
--logging_steps 10 \ --logging_steps 10 \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment