Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ColossalAI
Commits
a4ae43f0
Unverified
Commit
a4ae43f0
authored
Feb 09, 2023
by
Frank Lee
Committed by
GitHub
Feb 09, 2023
Browse files
[doc] added docusaurus-based version control (#2656)
parent
85b2303b
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
76 additions
and
0 deletions
+76
-0
docs/sidebars.js
docs/sidebars.js
+73
-0
docs/versions.json
docs/versions.json
+3
-0
No files found.
docs/sidebars.js
0 → 100644
View file @
a4ae43f0
module
.
exports
=
{
docs
:
[
{
type
:
'
category
'
,
label
:
'
Get started
'
,
collapsed
:
false
,
items
:
[
'
get_started/installation
'
,
'
get_started/run_demo
'
,
'
get_started/reading_roadmap
'
],
},
{
type
:
'
category
'
,
label
:
'
Concepts
'
,
collapsed
:
false
,
items
:
[
'
concepts/distributed_training
'
,
'
concepts/paradigms_of_parallelism
'
,
'
concepts/colossalai_overview
'
],
},
{
type
:
'
category
'
,
label
:
'
Basics
'
,
collapsed
:
false
,
items
:
[
'
basics/command_line_tool
'
,
'
basics/define_your_config
'
,
'
basics/launch_colossalai
'
,
'
basics/initialize_features
'
,
'
basics/engine_trainer
'
,
'
basics/configure_parallelization
'
,
'
basics/model_checkpoint
'
,
'
basics/colotensor_concept
'
,
],
},
{
type
:
'
category
'
,
label
:
'
Features
'
,
collapsed
:
false
,
items
:
[
'
features/mixed_precision_training
'
,
'
features/gradient_accumulation
'
,
'
features/gradient_clipping
'
,
'
features/gradient_handler
'
,
'
features/zero_with_chunk
'
,
{
type
:
'
category
'
,
label
:
'
Tensor Parallel
'
,
collapsed
:
true
,
items
:
[
'
features/1D_tensor_parallel
'
,
'
features/2D_tensor_parallel
'
,
'
features/2p5D_tensor_parallel
'
,
'
features/3D_tensor_parallel
'
,
],
},
'
features/pipeline_parallel
'
,
'
features/nvme_offload
'
],
},
{
type
:
'
category
'
,
label
:
'
Advanced Tutorials
'
,
collapsed
:
false
,
items
:
[
'
advanced_tutorials/train_vit_using_pipeline_parallelism
'
,
'
advanced_tutorials/train_vit_with_hybrid_parallelism
'
,
'
advanced_tutorials/train_gpt_using_hybrid_parallelism
'
,
'
advanced_tutorials/define_your_own_parallel_model
'
,
'
advanced_tutorials/add_your_parallel
'
,
'
advanced_tutorials/meet_gemini
'
,
'
advanced_tutorials/parallelize_your_training_like_Megatron
'
,
'
advanced_tutorials/integrate_mixture_of_experts_into_your_model
'
],
},
]
};
docs/versions.json
0 → 100644
View file @
a4ae43f0
[
"current"
]
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment