openwebtext/make_gpt2_sizes.py · 7890681a8ebd273fc6b1d163c3056c19d97cb097 · wxj / Megatron-LM

"vscode:/vscode.git/clone" did not exist on "d5c097a2f9ce139c70e8c08f45a05b6b44067398"

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

make_gpt2_sizes.py 982 Bytes

Replace make_gpt2_sizes.py