tests/L0/run_optimizers/test_dist_adam.py · 016c8d4f694f4f3d06bf9ee1d8442e955660fce5 · OpenDAS / apex

DistributedFusedAdam Model Parallelism Support (Megatron) (#981) · 6b7e77b0

Kexin Yu authored Dec 01, 2020



DistributedFusedAdam Model Parallelism Support (Megatron)
Co-authored-by: Kexin Yu <kexiny@nvidia.com>
Co-authored-by: Kexin Yu <kexinznzn@gmail.com>

6b7e77b0

test_dist_adam.py 5.78 KB

Replace test_dist_adam.py