tests/unit/test_cpu_adam.py · f5aa2547d88f145c4b5223d5bb8f79db69ee5288 · OpenDAS / deepspeed

Add CPUAdam optimizer for zero-offload in deepspeed engine (#484) · f5aa2547

Reza Yazdani authored Oct 30, 2020



* add adamW to CPU-ADAM implementation

* supporting cpu-adam optimizer for zero-offload on deepspeed side

* bump DSE to match cpu-adam updates
Co-authored-by: Jeff Rasley <jerasley@microsoft.com>

f5aa2547

test_cpu_adam.py 2.06 KB

Replace test_cpu_adam.py