megatron/schedules.py · 788b59e7bcba9b87cebdab73729e32c01f9853d0 · OpenDAS / Megatron-LM

Jared Casper authored Mar 03, 2021

Get PyTorch batched communication API working for interleaved schedule

See merge request ADLR/megatron-lm!242

788b59e7

schedules.py 17.5 KB