Skip to content

GitLab

"launcher/vscode:/vscode.git/clone" did not exist on "e3a63b6fbce709bf609ea406ca5f0c889e4a2c82"
Commit e5910c48 authored by zhougaofeng's avatar zhougaofeng
Browse files

Update multi_node.sh

parent 8d254593
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
finetune/multi_node.sh
View file @ e5910c48
...@@ -8,7 +8,7 @@ RANK=0 ...@@ -8,7 +8,7 @@ RANK=0
MASTER_ADDR=127.0.0.1 MASTER_ADDR=127.0.0.1
MASTER_PORT=17170 MASTER_PORT=17170
CUDA_VISIBLE_DEVICES=6,7 torchrun \ HIP_VISIBLE_DEVICES=6,7 torchrun \
--nproc_per_node $NPROC_PER_NODE \ --nproc_per_node $NPROC_PER_NODE \
--nnodes $NNODES \ --nnodes $NNODES \
--node_rank $RANK \ --node_rank $RANK \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment