Commit 2b56526d authored by “yuguo”'s avatar “yuguo”
Browse files

update

parent 15bcbc24
......@@ -49,9 +49,7 @@ pip3 install -e . -i https://mirrors.aliyun.com/pypi/simple
├── bert-base-chinese-vocab
├── gpt2-merges
└── gpt2-vocab
## Bert预训练
### 训练
## 训练
该预训练脚本运行环境为1节点,4张DCU-Z100-16G。
......@@ -70,7 +68,7 @@ train.dist.pipeline_parallel_size = 1
cd home/bert-large_oneflow
bash tools/train.sh tools/train_net.py configs/bert_large_pretrain.py 4
### 精度
## 精度
训练数据:[https://oneflow-static.oss-cn-beijing.aliyuncs.com/ci-files/dataset/libai/gpt_dataset](链接)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment