Skip to content

GitLab

Commit 03a82e76 authored by zhaoying1's avatar zhaoying1
Browse files

Update lora_train.sh

parent 8209fdc6
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
ptuning/lora_train.sh
View file @ 03a82e76
...@@ -7,7 +7,6 @@ deepspeed main.py \ ...@@ -7,7 +7,6 @@ deepspeed main.py \
--preprocessing_num_workers 10 \ --preprocessing_num_workers 10 \
--prompt_column content \ --prompt_column content \
--response_column summary \ --response_column summary \
--overwrite_cache \
--model_name_or_path THUDM/chatglm-6b \ --model_name_or_path THUDM/chatglm-6b \
--output_dir ./output_lora/adgen-chatglm2-6b-lora_version \ --output_dir ./output_lora/adgen-chatglm2-6b-lora_version \
--overwrite_output_dir \ --overwrite_output_dir \
...@@ -21,5 +20,6 @@ deepspeed main.py \ ...@@ -21,5 +20,6 @@ deepspeed main.py \
--logging_steps 10 \ --logging_steps 10 \
--save_steps 500 \ --save_steps 500 \
--learning_rate 2e-5 \ --learning_rate 2e-5 \
--lora_r 32 --lora_r 32 \
--fp16
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment