mpu/layers.py · abe36e2e5fb9104eca2456945e12b49f93fce475 · wuxk1 / Megatron-LM

"llama/patches/0006-add-mllama-support.patch" did not exist on "d7d7e996621ab3d5793d6c1b26b60f0c8c36cd62"

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

layers.py 13.1 KB

Replace layers.py