API Guide ========= .. toctree:: :maxdepth: 4 models tensor_parallel context_parallel pipeline_parallel fusions transformer moe dist_checkpointing distributed datasets
