Skip to content

GitLab

Commit 49c37cd4 authored by dcuai's avatar dcuai
Browse files

Update PRE_SEQ_LEN=128

parent 729150b6
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
ptuning/ptuning_train.sh
View file @ 49c37cd4
PRE_SEQ_LEN=1024 PRE_SEQ_LEN=128
LR=5e-3 LR=5e-3
export HSA_FORCE_FINE_GRAIN_PCIE=1 export HSA_FORCE_FINE_GRAIN_PCIE=1
...@@ -26,4 +26,4 @@ HIP_VISIBLE_DEVICES=0,1,2,3 deepspeed --num_gpus=4 --master_port $MASTER_PORT ma ...@@ -26,4 +26,4 @@ HIP_VISIBLE_DEVICES=0,1,2,3 deepspeed --num_gpus=4 --master_port $MASTER_PORT ma
--save_steps 1000 \ --save_steps 1000 \
--learning_rate $LR \ --learning_rate $LR \
--pre_seq_len $PRE_SEQ_LEN \ --pre_seq_len $PRE_SEQ_LEN \
--fp16 \ --fp16 \
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment