Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
GPT2_pytorch
Commits
6bd15ea7
Commit
6bd15ea7
authored
Sep 18, 2023
by
hepj987
Browse files
调整精度说明
parent
0eed4566
Pipeline
#560
failed with stage
Changes
1
Pipelines
2
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
6 deletions
+0
-6
README.md
README.md
+0
-6
No files found.
README.md
View file @
6bd15ea7
...
...
@@ -129,12 +129,6 @@ SAVE_INTERVAL 保存频率
sh mpi-run-16B.sh(主要参数在single-16B.sh,参数类型与单节点相同, 默认以fp32精度训练,如需采用fp16精度可执行sh mpi-16B-fp16.sh)
```
### 16B模型验证
| 卡数 | lm loss value | lm loss PPL |
| :-------: | :-----------: | :----------: |
| 32 x 4DCU | 4.299443E+00 | 7.365877E+01 |
## GPT2文本生成
### 转换成多卡推理
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment