examples/pretrain_gpt_distributed_with_mp.sh · cb00a19603dd59ca6682d113d0c9111036eab418 · OpenDAS / Megatron-LM

slym authored Aug 10, 2021

consider the case of pipeline-model prallelism

clean up arugments

argument naming cleanup

update readme and examples

c1e0689d

pretrain_gpt_distributed_with_mp.sh 1.44 KB