scripts/pretrain_bert_distributed.sh · abe36e2e5fb9104eca2456945e12b49f93fce475 · wuxk1 / Megatron-LM

"src/lib/apis/tools/index.ts" did not exist on "a8c4588fb5ee8b9b588cec8213a86ba6e655721e"

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

pretrain_bert_distributed.sh 1.21 KB

Replace pretrain_bert_distributed.sh