Unverified Commit f69507dd authored by ver217's avatar ver217 Committed by GitHub
Browse files

update rst (#615)

parent 93f14d2a
colossalai.amp.apex\_amp.apex\_amp
==================================
.. automodule:: colossalai.amp.apex_amp.apex_amp
:members:
......@@ -3,3 +3,9 @@ colossalai.amp.apex\_amp
.. automodule:: colossalai.amp.apex_amp
:members:
.. toctree::
:maxdepth: 2
colossalai.amp.apex_amp.apex_amp
colossalai.amp.naive\_amp.naive\_amp
====================================
.. automodule:: colossalai.amp.naive_amp.naive_amp
:members:
......@@ -3,3 +3,9 @@ colossalai.amp.naive\_amp
.. automodule:: colossalai.amp.naive_amp
:members:
.. toctree::
:maxdepth: 2
colossalai.amp.naive_amp.naive_amp
colossalai.amp
==============
*This module contains different amp models and optimizers.*
.. automodule:: colossalai.amp
:members:
.. toctree::
:maxdepth: 2
......@@ -15,6 +16,3 @@ colossalai.amp
:maxdepth: 2
colossalai.amp.amp_type
.. automodule:: colossalai.amp
:members: convert_to_amp
......@@ -2,4 +2,10 @@ colossalai.amp.torch\_amp
=========================
.. automodule:: colossalai.amp.torch_amp
:members:
\ No newline at end of file
:members:
.. toctree::
:maxdepth: 2
colossalai.amp.torch_amp.torch_amp
colossalai.amp.torch\_amp.torch\_amp
====================================
.. automodule:: colossalai.amp.torch_amp.torch_amp
:members:
colossalai.builder
==================
*This module contains different methods to build* ``schedule``, ``model``, ``optimizer``,
``layers`` *and other important classes.*
.. automodule:: colossalai.builder
:members:
.. toctree::
:maxdepth: 2
......
colossalai.communication
========================
*This module contains different methods for communication in parallel training.*
.. automodule:: colossalai.communication
:members:
.. toctree::
:maxdepth: 2
......
colossalai.constants
====================
.. automodule:: colossalai.constants
:members:
colossalai.context.moe\_context
====================================
===============================
.. automodule:: colossalai.context.moe_context
:members:
\ No newline at end of file
:members:
......@@ -2,4 +2,4 @@ colossalai.context.process\_group\_initializer.initializer\_2d
==============================================================
.. automodule:: colossalai.context.process_group_initializer.initializer_2d
:members: Initializer_2D_Row, Initializer_2D_Col
:members:
......@@ -2,4 +2,4 @@ colossalai.context.process\_group\_initializer.initializer\_2p5d
================================================================
.. automodule:: colossalai.context.process_group_initializer.initializer_2p5d
:members: Initializer_2p5D_ROW, Initializer_2p5D_Col, Initializer_2p5D_Dep, Initializer_2p5D_XZ
:members:
......@@ -2,4 +2,4 @@ colossalai.context.process\_group\_initializer.initializer\_3d
==============================================================
.. automodule:: colossalai.context.process_group_initializer.initializer_3d
:members: Initializer_3D_Input, Initializer_3D_Weight, Initializer_3D_Output
:members:
......@@ -2,4 +2,4 @@ colossalai.context.process\_group\_initializer.initializer\_sequence
====================================================================
.. automodule:: colossalai.context.process_group_initializer.initializer_sequence
:members: Initializer_Sequence_DP
:members:
......@@ -14,7 +14,6 @@ colossalai.context.process\_group\_initializer
colossalai.context.process_group_initializer.initializer_3d
colossalai.context.process_group_initializer.initializer_data
colossalai.context.process_group_initializer.initializer_model
colossalai.context.process_group_initializer.initializer_moe
colossalai.context.process_group_initializer.initializer_pipeline
colossalai.context.process_group_initializer.initializer_sequence
colossalai.context.process_group_initializer.initializer_tensor
......
colossalai.context
==================
*This module is serving for receiving and passing user's configuration to all devices to
initialize and construct parallel training.*
.. automodule:: colossalai.context
:members:
.. toctree::
:maxdepth: 2
......@@ -15,9 +15,7 @@ initialize and construct parallel training.*
:maxdepth: 2
colossalai.context.config
colossalai.context.parallel_context
colossalai.context.moe_context
colossalai.context.parallel_context
colossalai.context.parallel_mode
.. automodule:: colossalai.context
:members:
colossalai.context.singleton_meta
colossalai.context.singleton\_meta
==================================
.. automodule:: colossalai.context.singleton_meta
:members:
colossalai.core
===============
.. automodule:: colossalai.core
:members:
colossalai.engine.ophooks
===========================
=========================
.. automodule:: colossalai.engine.ophooks
:members:
.. toctree::
:maxdepth: 2
colossalai.engine.ophooks.zero_hook
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment