Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
evt_fugx1
dcu_megatron
Commits
90ae7f5c
Commit
90ae7f5c
authored
May 12, 2025
by
silencealiang
Browse files
Update run_llama2_7B_1nodes.sh
parent
fe0b03b5
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
4 deletions
+5
-4
examples/llama/run_llama2_7B_1nodes.sh
examples/llama/run_llama2_7B_1nodes.sh
+5
-4
No files found.
examples/llama/run_llama2_7B_1nodes.sh
View file @
90ae7f5c
...
...
@@ -7,7 +7,8 @@ done
# Runs Llama2 7B model
source
/opt/dtk/env.sh
HOST
=
localhost
PORT
=
34577
DATA_PATH
=
"path to oscar-1GB_head-llama2_text_document"
TOKENIZER_MODEL_PATH
=
"path to tokenizer.model"
CHECKPOINT_PATH
=
"path to ckpt"
...
...
@@ -15,11 +16,11 @@ CHECKPOINT_PATH="path to ckpt"
mpirun
-np
8
--allow-run-as-root
\
train_llama2_7b_1nodes.sh
\
localhost
\
34577
\
${
HOST
}
\
${
PORT
}
\
--data_path
=
$DATA_PATH
\
--tokenizer_path
=
$TOKENIZER_MODEL_PATH
\
--checkpoint_path
=
$CHECKPOINT_PATH
\
--profiling
=
$profiling
>
log-1nodes-
`
date
+%F-%H%M
`
.log 2>&1
wait
\ No newline at end of file
wait
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment