Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
index.rst 311 Bytes
Newer Older
xingjinliang's avatar
升级megatron_v0.10  
xingjinliang committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20 
API Guide
=========

.. toctree::
   :maxdepth: 4

   models
   tensor_parallel
   context_parallel
   pipeline_parallel
   fusions
   transformer
   moe
   dist_checkpointing
   dist_optimizer
   distributed
   datasets
   num_microbatches_calculator
   optimizer_param_scheduler
   encoder_decoder_parallelism