Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
LLaMA_TencentPretrain_pytorch
Commits
946cea7d
Commit
946cea7d
authored
Nov 09, 2023
by
zhaoying1
Browse files
Update run-13b.sh
parent
dcff3c4d
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
multi_node/run-13b.sh
multi_node/run-13b.sh
+2
-2
No files found.
multi_node/run-13b.sh
View file @
946cea7d
...
...
@@ -9,7 +9,7 @@ export NCCL_P2P_LEVEL=5
rm
-rf
./hostfile/
*
echo
"START TIME:
$(
date
)
"
hostfile
=
./hostfile
/
$SLURM_JOB_ID
hostfile
=
./hostfile
np
=
$(
cat
$hostfile
|sort|uniq |wc
-l
)
np
=
$((
$np
*
4
))
...
...
@@ -17,4 +17,4 @@ np=$(($np*4))
which mpirun
mpirun
-np
$np
--allow-run-as-root
--hostfile
hostfile
--bind-to
none
--mca
btl_tcp_if_include enp97s0f1
`
pwd
`
/run-13b-single.sh 8
echo
"END TIME:
$(
date
)
"
\ No newline at end of file
echo
"END TIME:
$(
date
)
"
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment