Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
bert-large_oneflow
Commits
f13e37fd
"vscode:/vscode.git/clone" did not exist on "72dcc1705d290a2b6084d0fed97e6f52c670ae79"
Commit
f13e37fd
authored
Jul 11, 2024
by
chenzk
Browse files
add icon
parent
124d7959
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
8 additions
and
3 deletions
+8
-3
README.md
README.md
+8
-3
icon.png
icon.png
+0
-0
No files found.
README.md
View file @
f13e37fd
...
...
@@ -49,6 +49,13 @@ pip3 install -e . -i https://mirrors.aliyun.com/pypi/simple
├── bert-base-chinese-vocab
├── gpt2-merges
└── gpt2-vocab
训练数据:
-
https://oneflow-static.oss-cn-beijing.aliyuncs.com/ci-files/dataset/libai/gpt_dataset/gpt2-merges.txt
-
https://oneflow-static.oss-cn-beijing.aliyuncs.com/ci-files/dataset/libai/gpt_dataset/gpt2-vocab.json
数据集快速下载中心:
[
SCNet AIDatasets
](
http://113.200.138.88:18080/aidatasets
)
,项目中数据集可从快速下载通道下载:
[
gpt_dataset
](
http://113.200.138.88:18080/aidatasets/project-dependency/bert-large_oneflow
)
。
## 训练
该预训练脚本运行环境为1节点,4张DCU-Z100-16G。
...
...
@@ -72,8 +79,6 @@ train.dist.pipeline_parallel_size = 1
### 精度
训练数据:
[
https://oneflow-static.oss-cn-beijing.aliyuncs.com/ci-files/dataset/libai/gpt_dataset
](
链接
)
使用的GPGPU:4张DCU-Z100-16G。
模型精度:
...
...
@@ -86,7 +91,7 @@ train.dist.pipeline_parallel_size = 1
### 算法类别
`
自然语言处理
`
`
对话问答
`
### 热点应用行业
...
...
icon.png
0 → 100644
View file @
f13e37fd
53.8 KB
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment