Commit ee749132 authored by hepj987's avatar hepj987
Browse files

更新loss

parent 2f9cfcec
Pipeline #366 failed with stage
......@@ -122,11 +122,17 @@ SAVE_INTERVAL 保存频率
--eval-iters 验证iter
```
### 16B模型性能和收敛性
### 16B模型训练loss
| 卡数 | 性能(samples per second) | 收敛性lm loss value | 收敛性lm loss PPL |
| :-------: | :------------------------: | :-----------------: | :---------------: |
| 32 x 4DCU | 2.449 | 4.299443E+00 | 7.365877E+01 |
| 卡数 | 性能(samples per second) | lm loss |
| :-------: | :------------------------: | :----------: |
| 32 x 4DCU | 2.449 | 1.965622E+00 |
### 16B模型验证
| 卡数 | lm loss value | lm loss PPL |
| :-------: | :-----------: | :----------: |
| 32 x 4DCU | 4.299443E+00 | 7.365877E+01 |
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment