openwebtext/make_gpt2_dataset.py · 7890681a8ebd273fc6b1d163c3056c19d97cb097 · wxj / Megatron-LM

"README_ORIGIN.md" did not exist on "033f5c78f5bd0b6a16ad7e5e973ce765fbe19374"

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

make_gpt2_dataset.py 2.48 KB

Replace make_gpt2_dataset.py