Optimizer
----------------------------------------------------

``AdamW``
~~~~~~~~~~~~~~~~

.. autoclass:: pytorch_transformers.AdamW
    :members:

Schedules
----------------------------------------------------

.. autoclass:: pytorch_transformers.ConstantLRSchedule
    :members:

.. autoclass:: pytorch_transformers.WarmupConstantSchedule
    :members:

.. autoclass:: pytorch_transformers.WarmupCosineSchedule
    :members:

.. autoclass:: pytorch_transformers.WarmupCosineWithHardRestartsSchedule
    :members:

.. autoclass:: pytorch_transformers.WarmupLinearSchedule
    :members: