Skip to content

GitLab

Commit 42c0a1a9 authored by wanglch's avatar wanglch
Browse files

Update ds_zero3_work_dtk.sh

parent 6e6513b3
Pipeline #1309 canceled with stages
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 4 deletions
ds_zero3_work_dtk.sh
View file @ 42c0a1a9
#!/bin/bash #!/bin/bash
deepspeed --master_port $(shuf -n 1 -i 10000-65535) --include="localhost:4,5,6,7" /home/wanglch/projects/LLaMA-Factory/src/train.py \ deepspeed --master_port $(shuf -n 1 -i 10000-65535) --include="localhost:4,5,6,7" ./LLaMA-Factory/src/train.py \
--deepspeed /home/wanglch/projects/LLaMA-Factory/deepspeed.json \ --deepspeed /./deepspeed.json \
--stage sft \ --stage sft \
--do_train \ --do_train \
--model_name_or_path /home/wanglch/projects/XuanYuan/XuanYuan-13B-Chat \ --model_name_or_path /home/wanglch/projects/XuanYuan/XuanYuan-13B-Chat \
--dataset fingpt_sentiment \ --dataset fingpt_sentiment \
--dataset_dir /home/wanglch/projects/LLaMA-Factory/data \ --dataset_dir ./data \
--template qwen \ --template qwen \
--finetuning_type lora \ --finetuning_type lora \
--lora_target all \ --lora_target all \
--output_dir /home/wanglch/projects/saves/XuanYuan-13B-Chat/lora_multi_dtk/sft \ --output_dir ./XuanYuan-13B-Chat/lora_multi_dtk/sft \
--overwrite_output_dir \ --overwrite_output_dir \
--cutoff_len 1024 \ --cutoff_len 1024 \
--preprocessing_num_workers 1 \ --preprocessing_num_workers 1 \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment