Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
ed2d07ae
Commit
ed2d07ae
authored
Dec 16, 2024
by
wxj
Browse files
Update README.md
parent
8a13fabe
Pipeline
#2094
canceled with stages
Changes
1
Pipelines
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
README.md
README.md
+2
-2
No files found.
README.md
View file @
ed2d07ae
...
@@ -124,7 +124,7 @@ DATA_PATH="./dataset/oscar-1GB-gpt_text_document"
...
@@ -124,7 +124,7 @@ DATA_PATH="./dataset/oscar-1GB-gpt_text_document"
在master节点执行命令
在master节点执行命令
```
shell
```
shell
mpirun
--allow-run-as-root
-np
8
--hostfile
hosts
-mca
plm_rsh_no_tree_spawn 1
-mca
plm_rsh_args
"-p 12345"
--bind-to
none ./GPT_pretraining.sh 192.168.1.1
>
& GPT_pretraining.log
mpirun
--allow-run-as-root
-np
16
--hostfile
hosts
-mca
plm_rsh_no_tree_spawn 1
-mca
plm_rsh_args
"-p 12345"
--bind-to
none ./GPT_pretraining.sh 192.168.1.1
>
& GPT_pretraining.log
```
```
在
`GPT_pretraining.log`
中查看训练日志
在
`GPT_pretraining.log`
中查看训练日志
...
@@ -178,7 +178,7 @@ DATA_PATH="/datasets/oscar-1GB-llama_text_document"
...
@@ -178,7 +178,7 @@ DATA_PATH="/datasets/oscar-1GB-llama_text_document"
在master节点执行命令
在master节点执行命令
```
shell
```
shell
mpirun
--allow-run-as-root
-np
8
--hostfile
hosts
-mca
plm_rsh_no_tree_spawn 1
-mca
plm_rsh_args
"-p 12345"
--bind-to
none ./Llama_pretraining.sh 192.168.1.1
>
& Llama_pretraining.log
mpirun
--allow-run-as-root
-np
16
--hostfile
hosts
-mca
plm_rsh_no_tree_spawn 1
-mca
plm_rsh_args
"-p 12345"
--bind-to
none ./Llama_pretraining.sh 192.168.1.1
>
& Llama_pretraining.log
```
```
在
`Llama_pretraining.log`
中查看训练日志
在
`Llama_pretraining.log`
中查看训练日志
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment