Commit 6bd15ea7 authored by hepj987's avatar hepj987
Browse files

调整精度说明

parent 0eed4566
Pipeline #560 failed with stage
......@@ -129,12 +129,6 @@ SAVE_INTERVAL 保存频率
sh mpi-run-16B.sh(主要参数在single-16B.sh,参数类型与单节点相同, 默认以fp32精度训练,如需采用fp16精度可执行sh mpi-16B-fp16.sh)
```
### 16B模型验证
| 卡数 | lm loss value | lm loss PPL |
| :-------: | :-----------: | :----------: |
| 32 x 4DCU | 4.299443E+00 | 7.365877E+01 |
## GPT2文本生成
### 转换成多卡推理
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment