scripts/pretrain_gpt2.sh · abe36e2e5fb9104eca2456945e12b49f93fce475 · wuxk1 / Megatron-LM

"test/gtest-1.7.0/include/gtest/gtest-printers.h" did not exist on "32125697f271ed03209f686186c67eee2075856c"

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

pretrain_gpt2.sh 784 Bytes

Replace pretrain_gpt2.sh