"encoding/datasets/folder.py" did not exist on "7e19143c318894b25635bcb3814c9d02640edf33"
optim.rst 846 Bytes
Newer Older
Myle Ott's avatar
Myle Ott committed
1
2
3
4
5
6
7
8
.. role:: hidden
    :class: hidden-section

.. _optimizers:

Optimizers
==========

Myle Ott's avatar
Myle Ott committed
9
10
Optimizers update the Model parameters based on the gradients.

Myle Ott's avatar
Myle Ott committed
11
12
.. automodule:: fairseq.optim
    :members:
Myle Ott's avatar
Myle Ott committed
13
14
15
16
17

.. autoclass:: fairseq.optim.FairseqOptimizer
    :members:
    :undoc-members:

Myle Ott's avatar
Myle Ott committed
18
19
20
.. autoclass:: fairseq.optim.adadelta.Adadelta
    :members:
    :undoc-members:
Myle Ott's avatar
Myle Ott committed
21
22
23
.. autoclass:: fairseq.optim.adagrad.Adagrad
    :members:
    :undoc-members:
Myle Ott's avatar
Myle Ott committed
24
25
26
.. autoclass:: fairseq.optim.adafactor.FairseqAdafactor
    :members:
    :undoc-members:
Myle Ott's avatar
Myle Ott committed
27
28
29
30
31
32
33
34
35
36
37
38
.. autoclass:: fairseq.optim.adam.FairseqAdam
    :members:
    :undoc-members:
.. autoclass:: fairseq.optim.fp16_optimizer.FP16Optimizer
    :members:
    :undoc-members:
.. autoclass:: fairseq.optim.nag.FairseqNAG
    :members:
    :undoc-members:
.. autoclass:: fairseq.optim.sgd.SGD
    :members:
    :undoc-members: