Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
GPT2_pytorch
Commits
ee749132
Commit
ee749132
authored
Jun 16, 2023
by
hepj987
Browse files
更新loss
parent
2f9cfcec
Pipeline
#366
failed with stage
Changes
1
Pipelines
2
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
10 additions
and
4 deletions
+10
-4
README.md
README.md
+10
-4
No files found.
README.md
View file @
ee749132
...
...
@@ -122,11 +122,17 @@ SAVE_INTERVAL 保存频率
--eval-iters 验证iter
```
### 16B模型
性能和收敛性
### 16B模型
训练loss
| 卡数 | 性能(samples per second) | 收敛性lm loss value | 收敛性lm loss PPL |
| :-------: | :------------------------: | :-----------------: | :---------------: |
| 32 x 4DCU | 2.449 | 4.299443E+00 | 7.365877E+01 |
| 卡数 | 性能(samples per second) | lm loss |
| :-------: | :------------------------: | :----------: |
| 32 x 4DCU | 2.449 | 1.965622E+00 |
### 16B模型验证
| 卡数 | lm loss value | lm loss PPL |
| :-------: | :-----------: | :----------: |
| 32 x 4DCU | 4.299443E+00 | 7.365877E+01 |
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment