Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
bert-large_oneflow
Commits
2b56526d
Commit
2b56526d
authored
Oct 10, 2023
by
“yuguo”
Browse files
update
parent
15bcbc24
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
4 deletions
+2
-4
README.md
README.md
+2
-4
No files found.
README.md
View file @
2b56526d
...
...
@@ -49,9 +49,7 @@ pip3 install -e . -i https://mirrors.aliyun.com/pypi/simple
├── bert-base-chinese-vocab
├── gpt2-merges
└── gpt2-vocab
## Bert预训练
### 训练
## 训练
该预训练脚本运行环境为1节点,4张DCU-Z100-16G。
...
...
@@ -70,7 +68,7 @@ train.dist.pipeline_parallel_size = 1
cd home/bert-large_oneflow
bash tools/train.sh tools/train_net.py configs/bert_large_pretrain.py 4
##
#
精度
## 精度
训练数据:
[
https://oneflow-static.oss-cn-beijing.aliyuncs.com/ci-files/dataset/libai/gpt_dataset
](
链接
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment