Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
optimizer_schedules.rst 588 Bytes
Newer Older
thomwolf's avatar
big doc update [WIP]  
thomwolf committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26 
Optimizer
----------------------------------------------------

``AdamW``
~~~~~~~~~~~~~~~~

.. autoclass:: pytorch_transformers.AdamW
    :members:

Schedules
----------------------------------------------------

.. autoclass:: pytorch_transformers.ConstantLRSchedule
    :members:

.. autoclass:: pytorch_transformers.WarmupConstantSchedule
    :members:

.. autoclass:: pytorch_transformers.WarmupCosineSchedule
    :members:

.. autoclass:: pytorch_transformers.WarmupCosineWithHardRestartsSchedule
    :members:

.. autoclass:: pytorch_transformers.WarmupLinearSchedule
    :members: