Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
optimizers.rst 353 Bytes
Newer Older
Reza Yazdani's avatar
Add CPUAdam optimizer for zero-offload in deepspeed engine (#484)  
Reza Yazdani committed
1
2
3
4
5
6
7
8
9
10
11
12 
Optimizers
===================

DeepSpeed offers high-performance implementations of Adam and Lamb optimizers on CPU and GPU, respectively.

DeepSpeed CPU Adam
----------------------------
.. autoclass:: deepspeed.ops.adam.DeepSpeedCPUAdam

DeepSpeed Fused Lamb
----------------------------
.. autoclass:: deepspeed.ops.adam.DeepSpeedCPUAdam