Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ColossalAI
Commits
9833d814
Commit
9833d814
authored
May 21, 2022
by
binmakeswell
Browse files
[NFC] fix paper link
parent
cefc29ff
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
2 deletions
+2
-2
README-zh-Hans.md
README-zh-Hans.md
+1
-1
README.md
README.md
+1
-1
No files found.
README-zh-Hans.md
View file @
9833d814
...
@@ -83,7 +83,7 @@ Colossal-AI 为您提供了一系列并行训练组件。我们的目标是让
...
@@ -83,7 +83,7 @@ Colossal-AI 为您提供了一系列并行训练组件。我们的目标是让
-
流水线并行
-
流水线并行
-
1维,
[
2维
](
https://arxiv.org/abs/2104.05343
)
,
[
2.5维
](
https://arxiv.org/abs/2105.14500
)
,
[
3维
](
https://arxiv.org/abs/2105.14450
)
张量并行
-
1维,
[
2维
](
https://arxiv.org/abs/2104.05343
)
,
[
2.5维
](
https://arxiv.org/abs/2105.14500
)
,
[
3维
](
https://arxiv.org/abs/2105.14450
)
张量并行
-
[
序列并行
](
https://arxiv.org/abs/2105.13120
)
-
[
序列并行
](
https://arxiv.org/abs/2105.13120
)
-
[
零冗余优化器 (ZeRO)
](
https://arxiv.org/abs/
2
10
8
.0
5818
)
-
[
零冗余优化器 (ZeRO)
](
https://arxiv.org/abs/
19
10.0
2054
)
-
异构内存管理
-
异构内存管理
-
[
PatrickStar
](
https://arxiv.org/abs/2108.05818
)
-
[
PatrickStar
](
https://arxiv.org/abs/2108.05818
)
-
使用友好
-
使用友好
...
...
README.md
View file @
9833d814
...
@@ -85,7 +85,7 @@ distributed training in a few lines.
...
@@ -85,7 +85,7 @@ distributed training in a few lines.
-
Pipeline Parallelism
-
Pipeline Parallelism
-
1D,
[
2D
](
https://arxiv.org/abs/2104.05343
)
,
[
2.5D
](
https://arxiv.org/abs/2105.14500
)
,
[
3D
](
https://arxiv.org/abs/2105.14450
)
Tensor Parallelism
-
1D,
[
2D
](
https://arxiv.org/abs/2104.05343
)
,
[
2.5D
](
https://arxiv.org/abs/2105.14500
)
,
[
3D
](
https://arxiv.org/abs/2105.14450
)
Tensor Parallelism
-
[
Sequence Parallelism
](
https://arxiv.org/abs/2105.13120
)
-
[
Sequence Parallelism
](
https://arxiv.org/abs/2105.13120
)
-
[
Zero Redundancy Optimizer (ZeRO)
](
https://arxiv.org/abs/
2
10
8
.0
5818
)
-
[
Zero Redundancy Optimizer (ZeRO)
](
https://arxiv.org/abs/
19
10.0
2054
)
-
Heterogeneous Memory Menagement
-
Heterogeneous Memory Menagement
-
[
PatrickStar
](
https://arxiv.org/abs/2108.05818
)
-
[
PatrickStar
](
https://arxiv.org/abs/2108.05818
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment