syncbn.rst 735 Bytes
Newer Older
Hang Zhang's avatar
Hang Zhang committed
1
2
3
4
5
6
.. role:: hidden
    :class: hidden-section

Synchronized BatchNorm
======================

Hang Zhang's avatar
sync BN  
Hang Zhang committed
7
8
.. note::
    The original ``Self-Parallel`` version of ``BatchNorm`` has been deprecated in favor of PyTorch Compatible :class:`encoding.nn.BatchNorm2d`.
Hang Zhang's avatar
v1.0.1  
Hang Zhang committed
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27

.. currentmodule:: encoding.nn

Modules
-------

:hidden:`BatchNorm1d`
~~~~~~~~~~~~~~~~~~~~~~~~

.. autoclass:: BatchNorm1d
    :members:

:hidden:`BatchNorm2d`
~~~~~~~~~~~~~~~~~~~~~~~~

.. autoclass:: BatchNorm2d
    :members:


Hang Zhang's avatar
Hang Zhang committed
28
29
.. currentmodule:: encoding

Hang Zhang's avatar
v1.0.1  
Hang Zhang committed
30

Hang Zhang's avatar
Hang Zhang committed
31
32
33
Functions
---------

Hang Zhang's avatar
v1.0.1  
Hang Zhang committed
34
35
36
.. currentmodule:: encoding.functions


Hang Zhang's avatar
Hang Zhang committed
37
38
39
:hidden:`batchnormtrain`
~~~~~~~~~~~~~~~~~~~~~~~~

Hang Zhang's avatar
v1.0.1  
Hang Zhang committed
40
.. autofunction:: batchnormtrain
Hang Zhang's avatar
Hang Zhang committed
41
42
43
44

:hidden:`batchnormeval`
~~~~~~~~~~~~~~~~~~~~~~~

Hang Zhang's avatar
v1.0.1  
Hang Zhang committed
45
.. autofunction:: batchnormeval