Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
wxj
Megatron-LM
Commits
481609bb
Commit
481609bb
authored
Dec 09, 2024
by
xingjinliang
Browse files
add
parent
c0a53a34
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
README.md
README.md
+1
-1
No files found.
README.md
View file @
481609bb
...
@@ -84,7 +84,7 @@ python tools/preprocess_data.py \
...
@@ -84,7 +84,7 @@ python tools/preprocess_data.py \
## GPT预训练
## GPT预训练
### 分布式训练
### 分布式训练
-
修改DATA_PATH路径(示例脚本中使用的是
m
ixtral数据集,实际运行时请自行修改)
-
修改DATA_PATH路径(示例脚本中使用的是
M
ixtral
8x7B
数据集,实际运行时请自行修改)
```
bash
```
bash
VOCAB_FILE
=
gpt2-vocab.json
VOCAB_FILE
=
gpt2-vocab.json
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment