Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
dist_checkpointing.strategies.rst 1.44 KB
Newer Older
xingjinliang's avatar
升级megatron_v0.10  
xingjinliang committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50 
dist\_checkpointing.strategies package
======================================

Package defining different checkpoint formats (backends) and saving/loading algorithms (strategies).

Strategies can be used for implementing new checkpoint formats or implementing new (more optimal for a given use case) ways of saving/loading of existing formats.
Strategies are passed to `dist_checkpointing.load` and `dist_checkpointing.save` functions and control the actual saving/loading procedure.

Submodules
----------

dist\_checkpointing.strategies.base module
------------------------------------------

.. automodule:: core.dist_checkpointing.strategies.base
   :members:
   :undoc-members:
   :show-inheritance:

dist\_checkpointing.strategies.tensorstore module
-------------------------------------------------

.. automodule:: core.dist_checkpointing.strategies.tensorstore
   :members:
   :undoc-members:
   :show-inheritance:

dist\_checkpointing.strategies.two\_stage module
------------------------------------------------

.. automodule:: core.dist_checkpointing.strategies.two_stage
   :members:
   :undoc-members:
   :show-inheritance:

dist\_checkpointing.strategies.zarr module
------------------------------------------

.. automodule:: core.dist_checkpointing.strategies.zarr
   :members:
   :undoc-members:
   :show-inheritance:

Module contents
---------------

.. automodule:: core.dist_checkpointing.strategies
   :members:
   :undoc-members:
   :show-inheritance: