CompressionReference.rst 4.42 KB
Newer Older
colorjam's avatar
colorjam committed
1
2
Model Compression API Reference
===============================
Ningxin Zheng's avatar
Ningxin Zheng committed
3
4
5

.. contents::

colorjam's avatar
colorjam committed
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
Compressors
-----------

Compressor
^^^^^^^^^^

..  autoclass:: nni.compression.pytorch.compressor.Compressor
    :members:

..  autoclass:: nni.compression.pytorch.compressor.Pruner
    :members:

..  autoclass:: nni.compression.pytorch.compressor.Quantizer
    :members:


Module Wrapper
^^^^^^^^^^^^^^

..  autoclass:: nni.compression.pytorch.compressor.PrunerModuleWrapper
    :members:


..  autoclass:: nni.compression.pytorch.compressor.QuantizerModuleWrapper
    :members:

Weight Masker
^^^^^^^^^^^^^
..  autoclass:: nni.algorithms.compression.pytorch.pruning.weight_masker.WeightMasker
    :members:

37
..  autoclass:: nni.algorithms.compression.pytorch.pruning.structured_pruning_masker.StructuredWeightMasker
colorjam's avatar
colorjam committed
38
39
40
41
42
43
44
45
    :members:


Pruners
^^^^^^^
..  autoclass:: nni.algorithms.compression.pytorch.pruning.sensitivity_pruner.SensitivityPruner
    :members:

46
..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot_pruner.OneshotPruner
colorjam's avatar
colorjam committed
47
48
    :members:

49
..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot_pruner.LevelPruner
colorjam's avatar
colorjam committed
50
51
    :members:

52
..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot_pruner.L1FilterPruner
colorjam's avatar
colorjam committed
53
54
    :members:

55
..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot_pruner.L2FilterPruner
colorjam's avatar
colorjam committed
56
57
    :members:

58
..  autoclass:: nni.algorithms.compression.pytorch.pruning.one_shot_pruner.FPGMPruner
colorjam's avatar
colorjam committed
59
60
    :members:

61
..  autoclass:: nni.algorithms.compression.pytorch.pruning.iterative_pruner.IterativePruner
colorjam's avatar
colorjam committed
62
63
    :members:

64
..  autoclass:: nni.algorithms.compression.pytorch.pruning.iterative_pruner.SlimPruner
colorjam's avatar
colorjam committed
65
66
    :members:

67
..  autoclass:: nni.algorithms.compression.pytorch.pruning.iterative_pruner.TaylorFOWeightFilterPruner
colorjam's avatar
colorjam committed
68
69
    :members:

70
..  autoclass:: nni.algorithms.compression.pytorch.pruning.iterative_pruner.ActivationAPoZRankFilterPruner
colorjam's avatar
colorjam committed
71
72
    :members:

73
..  autoclass:: nni.algorithms.compression.pytorch.pruning.iterative_pruner.ActivationMeanRankFilterPruner
colorjam's avatar
colorjam committed
74
75
    :members:

76
..  autoclass:: nni.algorithms.compression.pytorch.pruning.iterative_pruner.AGPPruner
colorjam's avatar
colorjam committed
77
78
    :members:

79
..  autoclass:: nni.algorithms.compression.pytorch.pruning.iterative_pruner.ADMMPruner
colorjam's avatar
colorjam committed
80
81
82
83
84
85
86
87
88
89
90
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.auto_compress_pruner.AutoCompressPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.net_adapt_pruner.NetAdaptPruner
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.pruning.simulated_annealing_pruner.SimulatedAnnealingPruner
    :members:

91
92
93
..  autoclass:: nni.algorithms.compression.pytorch.pruning.lottery_ticket.LotteryTicketPruner
    :members:

Bill Wu's avatar
Bill Wu committed
94
95
..  autoclass:: nni.algorithms.compression.pytorch.pruning.transformer_pruner.TransformerHeadPruner
    :members:
colorjam's avatar
colorjam committed
96
97
98

Quantizers
^^^^^^^^^^
99
..  autoclass:: nni.algorithms.compression.pytorch.quantization.NaiveQuantizer
colorjam's avatar
colorjam committed
100
101
    :members:

102
..  autoclass:: nni.algorithms.compression.pytorch.quantization.QAT_Quantizer
colorjam's avatar
colorjam committed
103
104
    :members:

105
..  autoclass:: nni.algorithms.compression.pytorch.quantization.DoReFaQuantizer
colorjam's avatar
colorjam committed
106
107
    :members:

108
109
110
111
112
113
114
..  autoclass:: nni.algorithms.compression.pytorch.quantization.BNNQuantizer
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.quantization.LsqQuantizer
    :members:

..  autoclass:: nni.algorithms.compression.pytorch.quantization.ObserverQuantizer
colorjam's avatar
colorjam committed
115
116
    :members:

117
118
119
120
121
122
123
124
125
126
127
128
129
130
Model Speedup
-------------

Quantization Speedup
^^^^^^^^^^^^^^^^^^^^

..  autoclass:: nni.compression.pytorch.quantization_speedup.backend.BaseModelSpeedup
    :members:

..  autoclass:: nni.compression.pytorch.quantization_speedup.integrated_tensorrt.ModelSpeedupTensorRT
    :members:

..  autoclass:: nni.compression.pytorch.quantization_speedup.calibrator.Calibrator
    :members:
colorjam's avatar
colorjam committed
131
132
133


Compression Utilities
134
---------------------
Ningxin Zheng's avatar
Ningxin Zheng committed
135

colorjam's avatar
colorjam committed
136
137
138
Sensitivity Utilities
^^^^^^^^^^^^^^^^^^^^^

139
..  autoclass:: nni.compression.pytorch.utils.sensitivity_analysis.SensitivityAnalysis
Ningxin Zheng's avatar
Ningxin Zheng committed
140
141
    :members:

142
Topology Utilities
colorjam's avatar
colorjam committed
143
^^^^^^^^^^^^^^^^^^
Ningxin Zheng's avatar
Ningxin Zheng committed
144

145
..  autoclass:: nni.compression.pytorch.utils.shape_dependency.ChannelDependency
Ningxin Zheng's avatar
Ningxin Zheng committed
146
147
    :members:

148
..  autoclass:: nni.compression.pytorch.utils.shape_dependency.GroupDependency
Ningxin Zheng's avatar
Ningxin Zheng committed
149
    :members:
150

151
..  autoclass:: nni.compression.pytorch.utils.mask_conflict.GroupMaskConflict
152
153
    :members:

154
..  autoclass:: nni.compression.pytorch.utils.mask_conflict.ChannelMaskConflict
155
156
    :members:

157
Model FLOPs/Parameters Counter
colorjam's avatar
colorjam committed
158
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
159

160
..  autofunction:: nni.compression.pytorch.utils.counter.count_flops_params