CompressionReference.rst 4.06 KB
Newer Older
colorjam's avatar
colorjam committed
1
2
Model Compression API Reference
===============================
Ningxin Zheng's avatar
Ningxin Zheng committed
3
4
5

.. contents::

colorjam's avatar
colorjam committed
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
Compressors
-----------

Compressor
^^^^^^^^^^

..  autoclass:: nni.compression.pytorch.compressor.Compressor
    :members:

..  autoclass:: nni.compression.pytorch.compressor.Pruner
    :members:

..  autoclass:: nni.compression.pytorch.compressor.Quantizer
    :members:


Module Wrapper
^^^^^^^^^^^^^^

..  autoclass:: nni.compression.pytorch.compressor.PrunerModuleWrapper
    :members:


..  autoclass:: nni.compression.pytorch.compressor.QuantizerModuleWrapper
    :members:

Weight Masker
^^^^^^^^^^^^^
..  autoclass:: nni.algorithms.compression.pytorch.pruning.weight_masker.WeightMasker
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.structured_pruning.StructuredWeightMasker
    :members:


Pruners
^^^^^^^
..  autoclass:: nni.algorithms.compression.pytorch.pruning.sensitivity_pruner.SensitivityPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot.OneshotPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot.LevelPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot.SlimPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot.L1FilterPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot.L2FilterPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot.FPGMPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot.TaylorFOWeightFilterPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot.ActivationAPoZRankFilterPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot.ActivationMeanRankFilterPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.lottery_ticket.LotteryTicketPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.agp.AGPPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.admm_pruner.ADMMPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.auto_compress_pruner.AutoCompressPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.net_adapt_pruner.NetAdaptPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.simulated_annealing_pruner.SimulatedAnnealingPruner
    :members:


Quantizers
^^^^^^^^^^
..  autoclass:: nni.algorithms.compression.pytorch.quantization.quantizers.NaiveQuantizer
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.quantization.quantizers.QAT_Quantizer
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.quantization.quantizers.DoReFaQuantizer
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.quantization.quantizers.BNNQuantizer
    :members:

106
107
108
109
110
111
112
113
114
115
116
117
118
119
Model Speedup
-------------

Quantization Speedup
^^^^^^^^^^^^^^^^^^^^

..  autoclass:: nni.compression.pytorch.quantization_speedup.backend.BaseModelSpeedup
    :members:

..  autoclass:: nni.compression.pytorch.quantization_speedup.integrated_tensorrt.ModelSpeedupTensorRT
    :members:

..  autoclass:: nni.compression.pytorch.quantization_speedup.calibrator.Calibrator
    :members:
colorjam's avatar
colorjam committed
120
121
122


Compression Utilities
123
---------------------
Ningxin Zheng's avatar
Ningxin Zheng committed
124

colorjam's avatar
colorjam committed
125
126
127
Sensitivity Utilities
^^^^^^^^^^^^^^^^^^^^^

128
..  autoclass:: nni.compression.pytorch.utils.sensitivity_analysis.SensitivityAnalysis
Ningxin Zheng's avatar
Ningxin Zheng committed
129
130
    :members:

131
Topology Utilities
colorjam's avatar
colorjam committed
132
^^^^^^^^^^^^^^^^^^
Ningxin Zheng's avatar
Ningxin Zheng committed
133

134
..  autoclass:: nni.compression.pytorch.utils.shape_dependency.ChannelDependency
Ningxin Zheng's avatar
Ningxin Zheng committed
135
136
    :members:

137
..  autoclass:: nni.compression.pytorch.utils.shape_dependency.GroupDependency
Ningxin Zheng's avatar
Ningxin Zheng committed
138
    :members:
139

140
..  autoclass:: nni.compression.pytorch.utils.mask_conflict.CatMaskPadding
141
142
    :members:

143
..  autoclass:: nni.compression.pytorch.utils.mask_conflict.GroupMaskConflict
144
145
    :members:

146
..  autoclass:: nni.compression.pytorch.utils.mask_conflict.ChannelMaskConflict
147
148
    :members:

149
Model FLOPs/Parameters Counter
colorjam's avatar
colorjam committed
150
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
151

152
..  autofunction:: nni.compression.pytorch.utils.counter.count_flops_params