Skip to content

GitLab

Commit 72687f56 authored by yuguo960516yuguo's avatar yuguo960516yuguo
Browse files

v1.0

parent 4ff327d6
Show whitespace changes
Inline Side-by-side
Showing with 5 additions and 0 deletions
README.md
View file @ 72687f56
...@@ -140,7 +140,12 @@ train.dist.pipeline_parallel_size = 4 ...@@ -140,7 +140,12 @@ train.dist.pipeline_parallel_size = 4
| 卡数 | 分布式工具 | 收敛性 | | 卡数 | 分布式工具 | 收敛性 |
| :------: | :------: |:------: | | :------: | :------: |:------: |
| 96 | Libai-main | total_loss: 5.56/1299 iters | | 96 | Libai-main | total_loss: 5.56/1299 iters |
## 历史版本
- https://developer.hpccube.com/codes/modelzoo/GPT/-/tree/rel_v1.0
## 参考 ## 参考
* https://libai.readthedocs.io/en/latest/tutorials/get_started/quick_run.html * https://libai.readthedocs.io/en/latest/tutorials/get_started/quick_run.html
* https://github.com/Oneflow-Inc/oneflow * https://github.com/Oneflow-Inc/oneflow
* https://github.com/Oneflow-Inc/libai/blob/main/docs/source/notes/FAQ.md * https://github.com/Oneflow-Inc/libai/blob/main/docs/source/notes/FAQ.md
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment