pretrain_gpt2.py · abe36e2e5fb9104eca2456945e12b49f93fce475 · wxj / Megatron-LM

"benchmark/multi_turns/bench_other.py" did not exist on "f652494df16ef9fa0fac998ddf63961aee0849d4"

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

pretrain_gpt2.py 21.3 KB

Replace pretrain_gpt2.py