Commit 481609bb authored by xingjinliang's avatar xingjinliang
Browse files

add

parent c0a53a34
Pipeline #2054 canceled with stages
...@@ -84,7 +84,7 @@ python tools/preprocess_data.py \ ...@@ -84,7 +84,7 @@ python tools/preprocess_data.py \
## GPT预训练 ## GPT预训练
### 分布式训练 ### 分布式训练
- 修改DATA_PATH路径(示例脚本中使用的是mixtral数据集,实际运行时请自行修改) - 修改DATA_PATH路径(示例脚本中使用的是Mixtral8x7B数据集,实际运行时请自行修改)
```bash ```bash
VOCAB_FILE=gpt2-vocab.json VOCAB_FILE=gpt2-vocab.json
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment