-
Olatunji Ruwase authored
* Load non-DeepSpeed checkpoints into ZeRO optimizer * Handle parameters smaller than DP * Formatting fixes * Handle empty partitions * Fix perf bug Co-authored-by:Jeff Rasley <jerasley@microsoft.com>
4a3234e0
* Load non-DeepSpeed checkpoints into ZeRO optimizer
* Handle parameters smaller than DP
* Formatting fixes
* Handle empty partitions
* Fix perf bug
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>