Skip to content

GitLab

Commit 2b56526d authored by “yuguo”'s avatar “yuguo”
Browse files

update

parent 15bcbc24
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 4 deletions
README.md
View file @ 2b56526d
...@@ -49,9 +49,7 @@ pip3 install -e . -i https://mirrors.aliyun.com/pypi/simple ...@@ -49,9 +49,7 @@ pip3 install -e . -i https://mirrors.aliyun.com/pypi/simple
├── bert-base-chinese-vocab ├── bert-base-chinese-vocab
├── gpt2-merges ├── gpt2-merges
└── gpt2-vocab └── gpt2-vocab
## Bert预训练 ## 训练
### 训练
该预训练脚本运行环境为1节点，4张DCU-Z100-16G。 该预训练脚本运行环境为1节点，4张DCU-Z100-16G。
...@@ -70,7 +68,7 @@ train.dist.pipeline_parallel_size = 1 ...@@ -70,7 +68,7 @@ train.dist.pipeline_parallel_size = 1
cd home/bert-large_oneflow cd home/bert-large_oneflow
bash tools/train.sh tools/train_net.py configs/bert_large_pretrain.py 4 bash tools/train.sh tools/train_net.py configs/bert_large_pretrain.py 4
### 精度 ## 精度
训练数据：[https://oneflow-static.oss-cn-beijing.aliyuncs.com/ci-files/dataset/libai/gpt_dataset](链接) 训练数据：[https://oneflow-static.oss-cn-beijing.aliyuncs.com/ci-files/dataset/libai/gpt_dataset](链接)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment