Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ColossalAI
Commits
4f5f8f77
Unverified
Commit
4f5f8f77
authored
Aug 02, 2022
by
Jiarui Fang
Committed by
GitHub
Aug 02, 2022
Browse files
update nvme on readme (#1397)
parent
56b8863b
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
12 additions
and
0 deletions
+12
-0
README-zh-Hans.md
README-zh-Hans.md
+6
-0
README.md
README.md
+6
-0
No files found.
README-zh-Hans.md
View file @
4f5f8f77
...
@@ -150,6 +150,12 @@ Colossal-AI 为您提供了一系列并行组件。我们的目标是让您的
...
@@ -150,6 +150,12 @@ Colossal-AI 为您提供了一系列并行组件。我们的目标是让您的
-
用相同的硬件训练20倍大的模型
-
用相同的硬件训练20倍大的模型
<p
id=
"GPT-2-NVME"
align=
"center"
>
<img
src=
"https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/GPT2-NVME.png"
width=
800/
>
</p>
-
用相同的硬件训练120倍大的模型 (RTX 3080)
### PaLM
### PaLM
<p
id=
"PaLM-Single"
align=
"center"
>
<p
id=
"PaLM-Single"
align=
"center"
>
<img
src=
"https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/PaLM-GPU1.png"
width=
450/
>
<img
src=
"https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/PaLM-GPU1.png"
width=
450/
>
...
...
README.md
View file @
4f5f8f77
...
@@ -155,6 +155,12 @@ Please visit our [documentation](https://www.colossalai.org/) and [examples](htt
...
@@ -155,6 +155,12 @@ Please visit our [documentation](https://www.colossalai.org/) and [examples](htt
-
20x larger model size on the same hardware
-
20x larger model size on the same hardware
<p
id=
"GPT-2-NVME"
align=
"center"
>
<img
src=
"https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/GPT2-NVME.png"
width=
800/
>
</p>
-
120x larger model size on the same hardware (RTX 3080)
### PaLM
### PaLM
<p
id=
"PaLM-Single"
align=
"center"
>
<p
id=
"PaLM-Single"
align=
"center"
>
<img
src=
"https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/PaLM-GPU1.png"
width=
450/
>
<img
src=
"https://raw.githubusercontent.com/hpcaitech/public_assets/main/colossalai/img/PaLM-GPU1.png"
width=
450/
>
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment