Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "0694205c47fc725fa655031ed8a9a518f0a4ccb2"
Commit 09d9221b authored by zhougaofeng's avatar zhougaofeng
Browse files

Update multi_node.sh

parent 9f90a10d
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
finetune/multi_node.sh
View file @ 09d9221b
...@@ -17,7 +17,7 @@ CUDA_VISIBLE_DEVICES=6,7 torchrun \ ...@@ -17,7 +17,7 @@ CUDA_VISIBLE_DEVICES=6,7 torchrun \
src/train.py \ src/train.py \
--stage sft --do_train \ --stage sft --do_train \
--model_name_or_path /home/practice/internlm2-math-7b \ --model_name_or_path /home/practice/internlm2-math-7b \
--dataset alpaca_en_demo --template intern2 --finetuning_type lora --lora_target q_proj,v_proj \ --dataset alpaca_en_demo --template intern2 --finetuning_type lora --lora_target wqkv \
--output_dir saves/intern2/lora/sft \ --output_dir saves/intern2/lora/sft \
--overwrite_output_dir \ --overwrite_output_dir \
--overwrite_cache --per_device_train_batch_size 2 --gradient_accumulation_steps 32 --lr_scheduler_type cosine \ --overwrite_cache --per_device_train_batch_size 2 --gradient_accumulation_steps 32 --lr_scheduler_type cosine \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment