index.rst 6.78 KB
Newer Older
1
2
:orphan:

3
4
Tutorials
=========
5
6
7



8
.. raw:: html
9

10
    <div class="sphx-glr-thumbnails">
11
12


J-shang's avatar
J-shang committed
13
14
15
16
17
18
.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Introduction ------------">

.. only:: html

19
20
  .. image:: /tutorials/images/thumb/sphx_glr_pruning_speedup_thumb.png
    :alt: Speedup Model with Mask
J-shang's avatar
J-shang committed
21

22
  :ref:`sphx_glr_tutorials_pruning_speedup.py`
J-shang's avatar
J-shang committed
23
24
25

.. raw:: html

26
      <div class="sphx-glr-thumbnail-title">Speedup Model with Mask</div>
J-shang's avatar
J-shang committed
27
28
29
30
31
    </div>


.. raw:: html

32
    <div class="sphx-glr-thumbcontainer" tooltip=" Introduction ------------">
J-shang's avatar
J-shang committed
33
34
35

.. only:: html

36
37
  .. image:: /tutorials/images/thumb/sphx_glr_quantization_speedup_thumb.png
    :alt: SpeedUp Model with Calibration Config
J-shang's avatar
J-shang committed
38

39
  :ref:`sphx_glr_tutorials_quantization_speedup.py`
J-shang's avatar
J-shang committed
40
41
42

.. raw:: html

43
      <div class="sphx-glr-thumbnail-title">SpeedUp Model with Calibration Config</div>
J-shang's avatar
J-shang committed
44
45
46
47
48
    </div>


.. raw:: html

49
    <div class="sphx-glr-thumbcontainer" tooltip="Here is a four-minute video to get you started with model quantization.">
J-shang's avatar
J-shang committed
50
51
52

.. only:: html

53
54
  .. image:: /tutorials/images/thumb/sphx_glr_quantization_quick_start_mnist_thumb.png
    :alt: Quantization Quickstart
J-shang's avatar
J-shang committed
55

56
  :ref:`sphx_glr_tutorials_quantization_quick_start_mnist.py`
J-shang's avatar
J-shang committed
57
58
59

.. raw:: html

60
      <div class="sphx-glr-thumbnail-title">Quantization Quickstart</div>
J-shang's avatar
J-shang committed
61
62
63
64
65
    </div>


.. raw:: html

66
    <div class="sphx-glr-thumbcontainer" tooltip="Here is a three-minute video to get you started with model pruning.">
J-shang's avatar
J-shang committed
67
68
69

.. only:: html

70
71
  .. image:: /tutorials/images/thumb/sphx_glr_pruning_quick_start_mnist_thumb.png
    :alt: Pruning Quickstart
J-shang's avatar
J-shang committed
72

73
  :ref:`sphx_glr_tutorials_pruning_quick_start_mnist.py`
J-shang's avatar
J-shang committed
74
75
76

.. raw:: html

77
      <div class="sphx-glr-thumbnail-title">Pruning Quickstart</div>
J-shang's avatar
J-shang committed
78
79
80
    </div>


J-shang's avatar
J-shang committed
81
82
83
84
85
86
.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="To write a new quantization algorithm, you can write a class that inherits nni.compression.pyto...">

.. only:: html

87
88
  .. image:: /tutorials/images/thumb/sphx_glr_quantization_customize_thumb.png
    :alt: Customize a new quantization algorithm
J-shang's avatar
J-shang committed
89

90
  :ref:`sphx_glr_tutorials_quantization_customize.py`
J-shang's avatar
J-shang committed
91
92
93

.. raw:: html

94
      <div class="sphx-glr-thumbnail-title">Customize a new quantization algorithm</div>
J-shang's avatar
J-shang committed
95
96
97
    </div>


98
99
.. raw:: html

Yuge Zhang's avatar
Yuge Zhang committed
100
    <div class="sphx-glr-thumbcontainer" tooltip="In this tutorial, we show how to use NAS Benchmarks as datasets. For research purposes we somet...">
101
102
103

.. only:: html

104
105
  .. image:: /tutorials/images/thumb/sphx_glr_nasbench_as_dataset_thumb.png
    :alt: Use NAS Benchmarks as Datasets
106

107
  :ref:`sphx_glr_tutorials_nasbench_as_dataset.py`
108
109
110

.. raw:: html

111
      <div class="sphx-glr-thumbnail-title">Use NAS Benchmarks as Datasets</div>
112
113
114
    </div>


J-shang's avatar
J-shang committed
115
116
117
118
119
120
.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Users can easily customize a basic pruner in NNI. A large number of basic modules have been pro...">

.. only:: html

121
122
  .. image:: /tutorials/images/thumb/sphx_glr_pruning_customize_thumb.png
    :alt: Customize Basic Pruner
J-shang's avatar
J-shang committed
123

124
  :ref:`sphx_glr_tutorials_pruning_customize.py`
J-shang's avatar
J-shang committed
125
126
127

.. raw:: html

128
      <div class="sphx-glr-thumbnail-title">Customize Basic Pruner</div>
J-shang's avatar
J-shang committed
129
130
131
    </div>


132
.. raw:: html
J-shang's avatar
J-shang committed
133

134
135
136
137
138
139
140
141
    <div class="sphx-glr-thumbcontainer" tooltip="This is the 101 tutorial of Neural Architecture Search (NAS) on NNI. In this tutorial, we will ...">

.. only:: html

  .. image:: /tutorials/images/thumb/sphx_glr_hello_nas_thumb.png
    :alt: Hello, NAS!

  :ref:`sphx_glr_tutorials_hello_nas.py`
J-shang's avatar
J-shang committed
142

Yuge Zhang's avatar
Yuge Zhang committed
143
144
.. raw:: html

145
146
147
148
      <div class="sphx-glr-thumbnail-title">Hello, NAS!</div>
    </div>


149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="In this tutorial, we demonstrate how to search in the famous model space proposed in `DARTS`_.">

.. only:: html

  .. image:: /tutorials/images/thumb/sphx_glr_darts_thumb.png
    :alt: Searching in DARTS search space

  :ref:`sphx_glr_tutorials_darts.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Searching in DARTS search space</div>
    </div>


166
167
168
.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="Workable Pruning Process ------------------------">
Yuge Zhang's avatar
Yuge Zhang committed
169
170
171

.. only:: html

172
  .. image:: /tutorials/images/thumb/sphx_glr_pruning_bert_glue_thumb.png
J-shang's avatar
J-shang committed
173
    :alt: Pruning Bert on Task MNLI
174
175
176
177
178

  :ref:`sphx_glr_tutorials_pruning_bert_glue.py`

.. raw:: html

J-shang's avatar
J-shang committed
179
      <div class="sphx-glr-thumbnail-title">Pruning Bert on Task MNLI</div>
180
    </div>
Yuge Zhang's avatar
Yuge Zhang committed
181
182
183
184
185
186
187
188
189
190


.. raw:: html

    </div>


.. toctree::
   :hidden:

191
192
193
194
195
196
197
   /tutorials/pruning_speedup
   /tutorials/quantization_speedup
   /tutorials/quantization_quick_start_mnist
   /tutorials/pruning_quick_start_mnist
   /tutorials/quantization_customize
   /tutorials/nasbench_as_dataset
   /tutorials/pruning_customize
Yuge Zhang's avatar
Yuge Zhang committed
198
   /tutorials/hello_nas
199
   /tutorials/darts
200
   /tutorials/pruning_bert_glue
201
202
203



liuzhe-lz's avatar
liuzhe-lz committed
204

205
.. raw:: html
liuzhe-lz's avatar
liuzhe-lz committed
206

207
    <div class="sphx-glr-thumbnails">
liuzhe-lz's avatar
liuzhe-lz committed
208
209
210
211


.. raw:: html

liuzhe-lz's avatar
liuzhe-lz committed
212
    <div class="sphx-glr-thumbcontainer" tooltip="The tutorial consists of 4 steps: ">
liuzhe-lz's avatar
liuzhe-lz committed
213
214
215

.. only:: html

216
217
  .. image:: /tutorials/hpo_quickstart_pytorch/images/thumb/sphx_glr_main_thumb.png
    :alt: HPO Quickstart with PyTorch
liuzhe-lz's avatar
liuzhe-lz committed
218

219
  :ref:`sphx_glr_tutorials_hpo_quickstart_pytorch_main.py`
liuzhe-lz's avatar
liuzhe-lz committed
220
221
222

.. raw:: html

223
      <div class="sphx-glr-thumbnail-title">HPO Quickstart with PyTorch</div>
liuzhe-lz's avatar
liuzhe-lz committed
224
225
226
227
228
229
230
231
232
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="It can be run directly and will have the exact same result as original version.">

.. only:: html

233
234
  .. image:: /tutorials/hpo_quickstart_pytorch/images/thumb/sphx_glr_model_thumb.png
    :alt: Port PyTorch Quickstart to NNI
liuzhe-lz's avatar
liuzhe-lz committed
235

236
  :ref:`sphx_glr_tutorials_hpo_quickstart_pytorch_model.py`
liuzhe-lz's avatar
liuzhe-lz committed
237
238
239

.. raw:: html

240
      <div class="sphx-glr-thumbnail-title">Port PyTorch Quickstart to NNI</div>
liuzhe-lz's avatar
liuzhe-lz committed
241
242
243
244
245
    </div>


.. raw:: html

246
    </div>
liuzhe-lz's avatar
liuzhe-lz committed
247
248
249



liuzhe-lz's avatar
liuzhe-lz committed
250

251
.. raw:: html
liuzhe-lz's avatar
liuzhe-lz committed
252

253
    <div class="sphx-glr-thumbnails">
liuzhe-lz's avatar
liuzhe-lz committed
254
255
256
257
258
259
260
261


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="The tutorial consists of 4 steps: ">

.. only:: html

262
263
  .. image:: /tutorials/hpo_quickstart_tensorflow/images/thumb/sphx_glr_main_thumb.png
    :alt: HPO Quickstart with TensorFlow
liuzhe-lz's avatar
liuzhe-lz committed
264

265
  :ref:`sphx_glr_tutorials_hpo_quickstart_tensorflow_main.py`
liuzhe-lz's avatar
liuzhe-lz committed
266
267
268

.. raw:: html

269
      <div class="sphx-glr-thumbnail-title">HPO Quickstart with TensorFlow</div>
liuzhe-lz's avatar
liuzhe-lz committed
270
271
272
273
274
275
276
277
278
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="It can be run directly and will have the exact same result as original version.">

.. only:: html

279
280
281
282
283
284
285
286
287
  .. image:: /tutorials/hpo_quickstart_tensorflow/images/thumb/sphx_glr_model_thumb.png
    :alt: Port TensorFlow Quickstart to NNI

  :ref:`sphx_glr_tutorials_hpo_quickstart_tensorflow_model.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Port TensorFlow Quickstart to NNI</div>
    </div>
liuzhe-lz's avatar
liuzhe-lz committed
288
289
290
291
292
293
294
295
296


.. raw:: html

    </div>


.. toctree::
   :hidden:
297
   :includehidden:
liuzhe-lz's avatar
liuzhe-lz committed
298

299
300
   /tutorials/hpo_quickstart_pytorch/index.rst
   /tutorials/hpo_quickstart_tensorflow/index.rst
liuzhe-lz's avatar
liuzhe-lz committed
301
302
303



304
305
306
307
308
.. only:: html

 .. rst-class:: sphx-glr-signature

    `Gallery generated by Sphinx-Gallery <https://sphinx-gallery.github.io>`_